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Preface 


The rapid development of computer engineering in 
recent times has led to an expansion of application of 
mathematics. Quantitative methods have been introduced 
inlo practically every sphere of human activity. The 
use of computers in the economy requires skilled spe- 
cialisls who have a command of the methods of computa- 
tional mathematics. 

Computational mathematics is one of the principal 
disciplines «ecessary for the preparation of specialists 
for various branches of economy. By studying it students 
acquire theoretical knowledge and practical skill Lo 
solve various applied problems with the aid of mathemati- 
sal models and numerical methods that are realized on a 
computer, 

This study aid assumes Шаб the reader is aware of the 
elemenlary concepts of higher mathematics, i.e. contin- 
uity, the derivative and the integral. Lt covers three 
large divisions of mathematics: “Algebraic Methods” 
(Ch. 2-6), “Numerical Methods of Analysis” (Ch. 1, 7, 8) 
and “Numerical Methods of Solving Differentia! Equa- 
tions” (Ch. 9, 10). 

The theoretical material presented is illustrated by nu- 
merous examples. Each chapter is concluded by exer- 
cises for independent work. 

The following designations are used in the book: the 
signs [] and @ are used for the beginning and end of the 
proof of an assertion and the signs A and A for the be- 
ginning and end of the solution of a problem. 

We wish Lo express our gratitude Lo Assistant Professor 
N. 1. lonkin and L. V. Matveeva who reviewed the manu 
script and made valuable remarks which thus improved 
the text. 
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Introduction 


Before beginning the exposition of the material, we 
shall briefly characterize computational mathematics, 
for which purpose we shall answer the following three 
questions: 

(1) What is computational mathematics? 

(2) What се the distinctive features of computational 
mathematics which allow it to be a special division of 
mathematics? 

(3) What is the significance of computational mathe- 
matics for the economy? 

1. The lerm “computational matheiralics” means now 
a division of mathematics which studies problems con- 
nected with the use of computers. 

We can distinguish three trends іп computational 
mathematics. The first trend is connected. with the use of 
computers in various fields of research and applications 
and includes, in particular, numerical sulution of > rious 
malhematical problems. The second trend is con ected 
with the elaboration of new numerical methods and algo- 
rilhms and perfecting the old ones. The third trend is 
connected with the problems of the interaction of шап 
and computer. 

This book is devoted Lo the first trend, namely, the use 
of numerical methods when solving applied problems. 

The foundation on which computational mathematics 
is constructed is composed of various computing faci- 
lilies, computers first of all, whose rapid development is 
the most characteristic feature of the technological 
progress today. Thus, during the la. thirty years, the 
speed of computation increased from one operation per 
second (with the use of a slide rule) to 3 000 000 opera- 
tions per second, i.e, 3-10? times. It is appropriate to 
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recall that from the time when a steam engine was in- 
vented the speed of travel increased from 13 km per hour 
(the speed of a horse) to 40 000 km per hour (the speed 
of a cosmic vehicle), i.e. only 3-10? timos. 

2. We can use the following examples to illustrate the 
characteristic features of computational mathematics 
which distinguish it from pure mathematics. 

From the point of view of a "pure" mathematician, to 
solve a problem is to prove the existence of its solution 
and show a process which leads to a solution. For a pro- 
grammer, the time of obtaining a solution, i.c. the rate 
of convergence of the process, is often a more important 
factor. Thus, it is known that a solution of n simultaneous 
algebraic equations can be theoretically obtained for 
any specified n as a result of a finite number of operations, 
say, with the aid of the method of Cramer or Gauss. 
Therefore, from the viewpoint of a "pure" mathematician, 
a problem of this kind is considered to be solved. Howe- 
ver, when these methods are used in practical applica- 
tions, two difficulties, which can not always be overcome, 
are oflen encountered. The first difficulty is that for a 
sufficiently: large п the number of operations, although 
finite, is so large that it is impossible to carry out all 
of them even with the use of the most powerful computers. 
Thus, to Solve a system of n equalions by Cramer’s 
method, we must perform n:n! operations, and this consti- 
tutes 4.6 1019 operations for n = 20. Then, with the rate 
of 3-106 operations per second a computer must operate 
continuously for half a million years. Gauss’ method 
proves to be more efficient. With the use of this method, 
the number of operations needed to solve the same prob- 
lem is of the order of n. 

However, such a large number of operations generates 
a second principal difficulty: the errors resulting from all 
operations accumulate and exert such a great influence 
on the final result that it often becomes far distant from 
{һе true solution. 

Nowadays exact methods are usually used for solving 
systems of equations when their order is not higher than 
10°. Therefore, from the point of view of a programmer, 
the problem of solving a system whose order is higher 
than 10° is not at all trivial. To solve such a system, itẹ- 


Introduction 13 


fative methods are used which are approximate but pos- 
sess a significant advantage of nol accumulating compu- 
tational errors from iteration to iteration. Thus we deal 
with a seemingly paradoxical situation, but one that is 
typical of numerical methods, namely, that approximate 
algorithms are preferred to exact ones. 

3. The essential expansion of the fields of application 
of computational mathematics, including its inculcation 
into econoiny, can be explained by the fact that natural 
phenomena and the phenomena of social life, different 
in their sense, are often similar in formal structure and 
can, consequently, be described by the same mathemati- 
cal models. We can therefore use the same numerical 
methods to solve the problems described by these models. 

Comr.'ers are principal factors making for the acce- 
leration of the scientific and technical progress, for the 
realization of the complex and purposeful programs of 
solution of the most important scientific and technological 
problems and for the further increase in the productivity 
of labour. The development of comp ters and compula- 
tional mathematics will make it possible, for instanco, 
to pass from the aulomatization of the control of techno- 
logical systems and processes to the automatizalion of 
the control of production processes. 


Chapter 1 


Elementary Theory of Errors 


1.1. Exact and Approximate Numbers. Sources and 
Classification of Errors 


In the process of solving a problem, we have to deal 
with various numbers which may be exact or approxi- 
mate. Exact numbers give a true value of a number and 
approximate numbers give a value close Lo the true one, 
the degree of closeness being dependent on the error of 
calculation. 

For example, in the assertions “a cube has six faces”. 
"we have five fingers to a hand", “there are 32 students in 
a class”, “there are 582 pages in a book” the numbers 
6, 5, 32 and 582 are exact ones. In the assertions “the 
house is 14.25 m wide”, “the radius of the Earth is 
6000 km", “the mass of a match box is ten g" the numbers 
14.25, 6000 and 10 are approximate. 

This is due, first of all, to the imperfection of measuring 
instruments we use. There are no absolutely exact mea- 
suring instruments, cach of them has its own accuracy, 
i.e. admits of a certain error of measurements. In addition, 
in the second example the approximation of a num- 
ber is in the very concept of the radius of the Earth. The 
matter is that, strictly speaking, the Earth is not a sphere 
and we can speak of its radius only in approximate terms. 
In the next example, the approximation of the number is 
also defined by the fact that different boxes may have 
different masses and the number 10 defines the mass of a 
certain box. 

In other cases, the same number may be exact as well 
as a, proximate. Thus, for instance, the number З is exact 
if we speak of the number of sides of a triangle and approx- 
imate if we use it instead of the number x when calculat- 
ing the area of a circle using the formula S = xR. 

In practical calculations, we understand the approzi- 
mate number a to be a number which differs but slightly 
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from the exact number A and can be substituted for it 
in calculations. 

The solution of the majority of practical problems 
with a certain degree of conventionality can be represent- 
ed as two successive stages: (1) the mathematical descrip- 
tion of the problem on hand, (2) the solution of the for- 
mulated mathematical problem. 

At Lhe first stage, we may encounter two characteristic 
sources of errors. First, the fact that the processes hap- 
pening in reality can not always be described by means 
of mathematics and the simplifications we introduce make 
it possible to obtain only more or less idealized models. 
Second, the initial parameters are, asa rule, inexact since 
ihey arc obtained from an experiment which gives only 
an apprcrimate result. 

Accordingly, the total error of a mathematical model 
and initial data is considered to be the error of the initial 
information. Having in mind that this error is independent 
of the second stage of solving the problem, we often call 
it a nonremovable error. 

It is, as a rule, unrealizable in practice to obtain an 
exact solution of a mathematical problem (the second 
stage) irrespective of whether it is constructed analytically 
or on a computer. Thus, for instance, we can obtain an 
exact solution for only a very restricted class of differen- 
tial equations. Therefore, in practical calculations. ve usu- 
ally use the methods of approximation of sc .tions, 
numerical first of all. 

Such a compulsory replacement of an exac: solution 
by an approximate one generates an error of the method 
or, as it is often called, an error of approximation. 

Finally, in the process of problem solving, we round 
off the initial data as well as the intermediate and final 
results. These errors and the errors arising in the arithme- 
tic operations involving approximate numbers affect, 
more or less, the result of calculations and form a so- 
called rounding error. 

In this connection, when we fori. ‘late a problem, we 
either indicate the accuracy of the solution required, i.e. 
specify the maximum error permissible in all calcula- 
tions, or only calculate the total error of the result. There- 
fore, when dealing with approximate numbers, it is 
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necessary to know how to solve the following problems: 
(1) to characterize the exactness of approximate num- 
bers by mathematical means, 
(2) to estimate the degree of accuracy of the result 
when we know the degree of accuracy of the initial data, 
(3) to choose initial data with the degree of accuracy 
which will ensure the specified accuracy of the result, 
(4) to construct an optimal computing process in order 
to obviate the calculations which do not affect the valid 
digits of the result. 


1.2, Decimal Notation and Rounding off Numbers 


Every decimal positive number a can be represented as 
a finite or infinite decimal fraction 


а == a40” 4 o, 107-3... . +a, 407-4... (4) 


where a, are the digits constituting the number ü = 1, 
2,..., 0, ...) with a, #0, and m is the top digit in 
the number a. 


Example 1. Hepresent the number 1905.0778 in form (1): 


1905.0778 = 1-103 + 9.10? + 0-10! + 5.10%-- 0-107! 
T 1-107? + 7.1073 + 8-10-74. 


Every unit in the corresponding ith decimal position, 
reckoning from left to right, has its value 107-5*! known 
as the value of the decimal position. Thus the value of the 
first (from the left) decimal position is 10", that of the 
second is 107-1 and so on. 

In the example considered, the value of the decimal position 


containing the digit 9 is 403-242 = 100, of that containing the digit 
5 із 103-451 = 1, of that containing the digit 8 із 103-841 = 0.0001. 


In practical calculations we often have to round off a 
number, i.e. to replace it by another number consisting 
of a smaller number of digits. In that case we retain one 
or several digits, reckoning from left to right, and discard 
all the others. 

The following rules of rounding off are most often used. 

1°. If the discarded digits constitute a number which is 
larger than half the unit in the last decimal place that re- 
mains, then the last digit that is left is strengthened (in- 
creased by unity). 
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Now if the discarded digits constitute a number which 18 
smaller than half the unit in the last decimal place that re- 
mains, then the digits that remain do not change. 

29 If the discarded digits constitute a number which is 
equal to half the unit in the last decimal place that remains, 
then the last digit that is left is strengthened, if it is odd, 
and is unchanged if it is even. 

This rule is often called a rule of an even digit. 

Example 2. Round ой the following numbers: A, = 12.7852, 
4s = 394.261, Аҙ = 6.265001, A, = 147.5, А, = 148.5 to three 

igits. 

A In accordance with item 1? of the rules of rounding off, 
we get a, = 12.8, а, = 394, a, = 6.27 since 0.0852 > 0.5.1071, 
0.261 < 0.5.10, 0.005001 >> 0.5-10-2. 

In accordance with item 2? of the rules of rounding ой, we get 
ад = 148,04 = 148 since thedigit 7 is odd and the digit 8 is even. A 

In som. ‘saag which are more and more often encountered 
nowadays, use 1s made of a more simple rule of rounding off. This 
rule consists in a simple discarding of all digits beginning with 
а certain decimal place. Using this rule, we would get the following 
values when rounding off the numbers from the examples consid- 
егей: a, >= 12.7, a, — 394, a, — 0.20, а, = 147, ag = 148. 


1.3. Absolute and Relative Errors 


Let A bean exact number and а, its approximate val- 
ue, If а < А, then we say that the number a is an арргох- 
imate value of the number А by defect and if a >A, 
then it is an approximate value of A hy excess. 

The difference between the exact number A id its 
approximation а is an error. 

As a rule, it is impossible to determine the value of the 
error A — a and even its sign since the exact number A 
is unknown. Therefore we use Ше upper bound of the ab- 
solute value of the error rather than the error itself. 

The absolute error of the approximate number a is a 
quantity A, which satislles the inequality 


A,>|A—a|. (1) 


The absolute error is the upper bound of the deviation 
of the exact number A from its approximation: 


a—A,<A<a+t As. (2) 
Inequality (2) is often written in the form 
A =at А,. (3) 
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The number taken as an absolute error must be as 
small as possible. For instance, measuring the length of a 
line segment, we have found that the error of measure- 
ment does not exceed 0.5 cm, all the more so it does not 
exceed 1, 2 and 3 cm. Each of these numbers can be ta- 
ken as the absolute error. However, we must take the 
smallest of these numbers as the absolute error since the 
sinaller the absolute error, the narrower the interval 
within which we specify the exact number. 

In practical calculations we often use expressions 
"with an accuracy to 0.01", “with an accuracy to 1 cm” 
etc. This means that the absolute error is equal to 0.04, 
1 cm etc. respectively. 


Example 1. We have measured the length of the lino segment L 
with an accuracy to 0.05 cm and obtained і = 18.4 cm. The absolute 
error here A, — 0.05 cm. In accordance with formula (3), we must 
write L = 18.4 + 0.05 cm. According to formula (2), the exact 
value of the length of the segment is within the interval 18.35 < 
L < 18.45. 

Example 2. We have measured the length of the line segment L 
using a ruler with tho value of the division 0.1 cm. We have found 
tbat the exact value of L is between 4.6 and 4.7. In this case, wo must 
take | = 4.65, i.e. the middle of the interval within which the 
exact number L із, as the approximate value. The absolute error is, 
evidently, half the value of the division of the ruler, i.e. A, = 0.05 
Thus L =-4.65 + 0.05 cm. 


The absolute error reflects only the quantitative aspect 
of the error but not the qualitative one, i.e. does not show 
whether the measurement and calculation were accurate. 
Indeed, assume that measuring the length and the width 
of the top of a table with a ruler the value of whose divi- 
sion is 1 cm, we have got the following results (in cm): 
the width L, = 2 + 0.5 and the length 2, = 100 + 
0.5. In both measurements the absolute error is the 
same and constitutes 0.5 cm. It is evident, however, that 
the second measurement was more accurate than the first. 
To estimate the quality of calculations or measurements, 
the céncept of a relative error is introduced. 

The relative error of the approximate number a is the 
quantity 6, which satisfies the inequality 


b> E|, ao. (4) 
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In particular, we can accept 


A 
mE 


a0, (5) 





as the relative error. and represent relation (3) in the form 
А == a (1 + би). (6) 


Note that a relative error is an abstract number and 
is often expressed in per cent. 


Now we return to the measurements of the length and the width 
of the top of the table and find their relativo errors: 


ôn = 0.5/2 = 0.25 or 25%, бі, = 0.5/100 = 0.005 or 0.5%. 


In suck cases we say that the measurement of tho length of the 
top of the tahle has been relatively more accurate (50 times as accu- 
rate) thau (uet of its width. 

Example 3. An exact number A is in the interval [23.07, 23.10]. 
Find its approximate value, the absolute and the relative error. 

A We assume the middle of the given interval to be its approx- 
imate value: a — 23.085. Тһе absolute error is half its length: 
Ag = 0.015. We лззоте 6, = А,/а = 0.000604 . . . to be the rela- 
tive error. It is customary to round off the value of the error to 
one or two nonzero digits. Therefore we can set 6 — 0.0796. Note 
that in problems of this kind the error is usually rounded off to 
a larger number in order that inequalities (2) and (4) should be 
satisfied. A 

Example 4. Determine, in per cent, the relative error of the 
approximate number a = 35.148 if A = 35.148 + 0.00074. 

A Using formula (5), we have 


B, = Ag/a = 0,00074/35.148 = 0,022 гє 0.00396. д 
Example 5. Determine the absolute. «ог of the approximate 
number g = 4.123 if 6, = 0.01% 


A We write the percentage in юна of a decimal fraction 
and use formula (5) to find thea error, Then we have 


Ag = | a |: Bg = 4.123-€0001 a 0.0005, 
A = 4423 + 0.0005. А 


Example 6. Find out in whigh af the two following oases the 
quality of calculations is Мрђа: A, = 13/19 = 0.684 or А, = 


V 52 ex 7.21. 

A To find the absolute өггоге, we take numbers a, and a, with 
a larger number of decimal ; 43, 3 = 0.68421, 52 = 
7.2111... . We determine the q errors by rounding them 


off to a larger number: 
Ag, = | 0.68421 ... — 0.084 | ax 0.00022, 
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Ag, = | 7.2111... — 7.21 | == 0.0012. 
We seek the rolative errors: 
ба, = да, a, | = 0.00022/0.684 == 0.00033 œ 0.04%, 
8a, = да, а, | = 0.0012/7.21== 0.00017 = 0.02%. 


In the second case the quality of calculation proved to be higher 
since ôg, < ба, 


1.4. Valid Significant Digits 


When we solve a problem, we often stipulate that the 
result must be obtained with an accuracy of 0.1, 0.01 etc. 
It may seem that the accuracy of calculations is defined 
by the number of digits after the decimal point. This is 
nol so, however. The accuracy of calculations is defined by 
the number of digits in the result which enjoy confidence. 

The significant digits of a number arc all its digits, ex- 
cept for zeros, which appear to the left of the first non- 
zero digit. 

Zeros al tlie end of a number are always significant di- 
gits (otherwise they are nol wrilten). 

Example: 1. Tho numbers 0.001604 and 30.500 have 4 and 5 
significant digits respectively. 

There are certain subtle points in the representation of 
integers. Thus, for instance, if we want to show that the 
last three zeros in the number 400 000 are not significant, 
we must write this number as two factors: 400-10°, or 
40.0-10*, or 0.400-10°. The last form of the notation is 
known as normalized and is preferable. In this case we 
say that 400 is the mantissa of the number and 6 is its 
order. 

Recall that every positive decimal number, exact as 
well as approximate, can be represented as 


a — a, 10" + a, 107-1... о, 100-1 4... 


The digit a, of the approximate number a is a valid 
significant digil (or simply a valid digit) if there holds an 


inequality n 
ТА — а J2&Q.5 107-"*!, (1) 


i.e. if the lute value of 
number ag@sits approximate v 







e difference of the exact 
e does not exceed half 
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the unit of the decimal digit in which о, appears. 

Since instead of | А--а | we usually consider the 
absolute error A,, we often replace inequality (1) by 
an inequalily 


A, < 0.5.10т-"+! (2) 


because when this inequality is satisfied, the initial ine- 
quality (1) is satisfied Loo. 

On the other hand, if the number z of valid «ішін of 
the approximate number a is specilied, then we can take 


A, = 0.5-40"-"+ (3) 


as Ше absolute error. 

If ineguality (2) is nol satisfied, then the digit а, 
is said to he doubtful. It is evident that if the digit о, 
is valid, thea all the preceding digits. to the left of it, 
are also valid. 


Example 2, We have obtained the number a = 23.10 by round- 
ing off an exact n" nber. ilow many valid digits are there in the 
number a? 

А When a number is rounded off according to the rule of an 
oven digit, the absolute error cannot exceed half the unit in tho 
Jast decimal place that remains. This means that all the remaining 
digits in the rounded-off number are valid. In this case, evidently, 
all the four digits are valid and the error A, = 0.005. A 

Example 3. The number a -- 23.071937 contains five valid 
digits. Find its absolute error. 

A We use formula (3). Here m := 1, n = ж, and so we n take 
A, = 0.5.101-5*1 -- 0.0005 as the absolute error. A 

Example 4. The absolute error of the number a — 705.1978 
is A, = 0.3. Find out which of the digits of the number a are 
valid and round off the number а leaving only valid digits. 

A We use formula (2). Here m = 2, Ag = 2.3 and n must be 
found from the inequality 0.3 < 0.5-109-". A direct verification 
shows that the greatest n which satisfies this inequality is equal 
to З and the digit 5 is valid: 0.3 < 0.5-102-3+1, and the digit 1 
is doubtful: 0.3 > 0.5-10?-1*!, 

Consequently, the number a -= 705.1978 has three valid digits. 
We round it off 10 three digits: a, = 705. Then the total error is 
equal to the sum of the initial error and the rounding error: A, == 
0.3 -+ 0.2 = 0.5, and so we can write А = 705 + 0.5 A 


In mathematical tables all siguilic: .t digits аге valid, 
as a rule. ‘Thus in the well-known tables of logarithms 
the values of the sine are given wilh an absolute error of 


0.5 -1071, 
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In recent years, tho concept of valid significant digits is more 
and more often used in the broad sense. This concept 18 connected 
with the simplest rule of rounding off which wc mentioned in 1.2. 

The digit а, of the approximate number 
а= 01:10" -- a4: 107-1. .. Han 40m-n 4 ,,, 
is a valid significant digit in the broad sense if there holds an ine- 


quality 
Ag x 1-10m-n«i, (4) 


i.o. if the absoluto error of tho number a does not exceed the unit 
of the decimal place in which a, appears. 


1.5. The Connection Between the Number of Valid Digils 
and the Error of the Number 


As follows from the definition of a valid significant 
digit, the number of the valid digits of ап approximate 
number is delined by the inequality 

[А — a |< 0.510711, (1) 


Dividing both sides of inequality (1) by |а |, we 
get 





А-а | (0,5.40т-теі 
| a |^ [m "Fa, IE Fa, fo 
0.5.10т-п+1 0.5 ‘ 
OX q:10" 7 a,-10^71 * (2) 


Thus, if the digit о, of the approximate number а is 
valid, then we can assume 
0,5 
ба = Sgr (3) 
{о be the relative error. 
On the other hand, for the digit о, of the approximate 
number a to be valid, it is necessary that the inequality 


0.5 
4 
ô< (a4 +1 .10n-1 (4) 
hold true since in this case inequalities (2) and (1) are sa- 
tisfied. 
When we mean valid significant digits in the broad sense, we 
can get a .similar formula 


бо 1 


“а domi: (5) 
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Example 1. What is the relative error of the approximate number 
a — 4.176 if all its digits are valid? 

А Since all the four digits of the number 4.176 are valid, 
wo use formula (3) to find the relative error: 
0.5 


ба- ay 401 2.54.1038 


£x 0.00013 = 0.013%. 


Note that the relative error of the number а сап be found from 
the formula 6, = A,/| а |. Since in the given number a all digits 
are valid, we have A4 — 0.0005. Then 


6, = 0.0005/4.176 = 0.00012 = 0.012%. 


We can see that the difference is not large, but applying for- 
mula (3), we somewhat simplify the calculations. 

Example 2. What is the relative error of the number a — 14.278 
if all its digits are valid in the broad sense? 

А Since all the five digits of the number are valid іп the broad 
sense, we can use formula (5) to obtain 


Г-- 


- -- 1 = = 0 
a, dona — 1.104 == 0,0004 — 0.0196 . А 


Example 3. How many decimal digits must be taken in the 
number V18 for ihe error not to exceed 0.1%? 
A Here A -- V 18224, ...; 6, «: 0.1%, і.е. 6, < 0.001. 


1 
We have ô, = 3.4-10n-i < 0.001, whence 125 < 107-1; 1.25 x 


102 < 107-1; log 1.25 --2 x: n— 1; a>3-+ 1061.25, i.e. 
п >> 4. ДА 


1.6. Тһе Errors ой а Sum and а Difference 
Consider the exacti numbers A,, A,,..., А, and their 


n 
approximations а), а, ... аһ. Let А = >) A, be the 
ici 


n 
sum of all exact numbers and а = УХ a; be the sum of 
ігі 
their approximations. We pose the following problem: 
being given the absolute errors Aq, Ag, ..., Ас, 
of all approximate numbers, evaluate the absolute error 
of their sum a. We set up a difference 
A —a = (А, — а) + (4, — а))--...-- (An — an). 


Passing to the absolute values on the right-hand and 
left-hand sides of the relation and using the property of 
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absolute values, we obtain 
|А-а|<|А,-а)|-- |4А,--а; | - 
T | А, — ay | * 
Consequently, 
lA—a]x As -- Aa, H... -H Aa, (1) 
and we сап take the sum of Ше absolute errors of the 
terms 


Aa = Mo, + Bebe + Ал, (2) 
as the absolute error of the approximate number a, i.e. 
the sum of the approximate numbers a,, 4), ..., а, 


lt follows from the last formula that the absolute error 
of the algebraic sum must, iu general, һе not smaller 
than the absolute error of the least exact term. There- 
fore, to obviate excess calculations, we should not leave 
unnecessary digits іп the more exacl terms either. 

When adding up numbers of different absolute accura- 
cy, we usually do the following: 

(1) isolate a number (or numbers) of the least accuracy 
(i.e. a number which has the greatest absolute crror), 

(2) round off more exact numbers so as Lo retain in Шет 
one digit more than in the isolated number (i.e. retain 
one reserve (1610), 

(3) perform addition taking into account all the re- 
tained digits, 

(4) round off the result obtained by discarding one digit. 

Remark. When the number of terms is large (п >> 10), 
the evaluation of the error of the sum by formula (2) 
proves to be too high since a parlial compensation of the 
errors of different signs usually occurs. If all the terms 
are rounded off to the mth decimal place, i.e. their errors 
are evaluated by the quantity 0.5-10-™, then the sla- 
tistical evaluation of the absolute error of the sum can be 
found from the following formula: 


= Vn-0.5-10-7. (3) 


Example 1. Add up “the approximate numbers a = 0.1732 -|- 
17,45 + b. 000333 +- 304. 4+ 7.25 -- 144.2 -}+ 0.0112 -|- 0.634 -l- 
0.0771 in eath of which all the written digits are valid. 

A^ We choose the least exact numbers (those possessing the 
greatest absolute error). There are two numbers oí this kind, 204.4 
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and 144.2. Tho orror of each of them is 0.05. We round off the other 
numbers, leaving one (reserve) sign more, and add up all the num- 
ers: 
0.17 
17.45 
0.00 
204 .4 
7.25 
144.2 
0.04 
0.63 
0.08 


374.19 


We round off the sum obtained discarding one digit: 374.2. 

We estimate the accuracy of the result. Tne absolute error of 
the sum consists of two terms: 

(1) the initial error, i.e. the sum of the errors of the least exact 
numbers az? the roundine errors of the other numbers: 0.05.2 + 
0.005.7 = 0.14, 

(2) the error of the rounding off the result: 0.01. 

Thus the absolute error of the sum is 0.15 and we must write 
the result in the form A == 374.2 + 0.15. Another form of notation, 
А = 374.2 + 0.2 is also possible. A 

We do [һе {rue in the case when onc or several approx- 
imate numbers are negative. 

Example 2. Find the difference of the approximate numbers a == 
a, — а, and evaluate the absolute and the relative error of the 
result if A, = 17.5 + 0.02 and A, = 45.6 + 0.03. 

^ We find that а<- a, — a, = 17.5 — 45.6 = —28 1: A, = 
Аа 1 44; = 0.02 -+ 0.03 = 0.05. Thus 4 - —28.1 + 5. We 
find the relative error: 6, == 0.05/| —28.1 | = 0.002 = 6 .%. A 

We can show that if the absolute error of the sum of 
approximate numbers сап be found from formula (2) 
and the relative error of the sum 6, = A, [а |, then 

min S 94 Omas. 


Example 3. Evaluate the relative error of the sum of the num- 
bers in Example 1 and compare it to the relative errors of the terms. 
А We lind tbe relativo error of the sum: 


6, = 0.2/374.2 = 0.0006 = 0.06%. 
The relative errors of tho terms are 


ôa, = 0.005/0.17 ~: 3%, 54, = 0.005. 7.45 — 0.03%, 
б, = 0.05/204.4 = 0.03%, a, = 0.005/7.25 = 0.07%, 
б, = 0.00/144.2 = 0.04%, 84, = 0.005/0.04 = 50%, 
бо, = 0.005/0.63 = 0.8%, — &,, = 0.005/0.08 = 7%. 
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Thus 8min = 0.03%, Ömar= 50%, 8, = 0.06%, ie. the 
relative error of the sum is between the least and the greatest rela- 
tive error of the terms. A 

Note that when subtraction concerns close numbers, a 
situetion may occur which is known as a loss of accuracy. 
Let x > 0, у> 0 апі а = х — y. Then 

6 = Ag _ Ax+ Ay 

4 fal  Iz—yl * 
Thus if tho numbers т and y differ but little from each 
other, then even for small errors А, and А,, the value 
of the relative error of the difference may turn to be con- 
siderable. 

Example 4. Le 
Ay = 0.0005, 8, = 
а= = у is 





t z= 5.125, y = 5.135. Here А, = 0.0005, 
5, ех 0.01%. The relative error of tho difference 


_ 0.0005 +0.0005. 
7 M 


Evidently, when subtraction concerns two close num- 
bers, a considerable loss of accuracy may occur. To 
obviate this, we must change the subtraction procedure 
so that small differences of the quantities are calculated 
directly. 

Example 5. Find the difference A = y 6.27 — y 6.26 and eva- 
luate the relative error of the result. 

A Let А, = V6.27 = 2.504, Ag, = 0.0005, А, = V6.26 ж 
2.502, Ag, = 0.0005. Then а = 2.504 — 2.502 = 0.2-10-3, A, = 
0.0005 + 0.0005 = 0.001, whence 

s, 01:107 
47 0,2.40-3 


However, chauging the scheme of calculation, we can get а bet- 
ter evaluation of the relative error: 


^t za (V6.27—V 6.26)(V 6.27-- V 6.26) 
А- 0.27 — 6.26 = ———————————— 
y 4 V 6.27 4- V 8.26 
6.27 —6.26 0.01 
= тшш "ышы LL ————————— 0,210732 = 1 
/6.27--V 6.26 — V 6.224- V 6.26 ж a 
Sart Aas _ 0.001 
а-Ға 5 


Thus, when calculating a, and a, with the same four valid digits, 
we "^ got an essentially better regult in the sense of a relative 
error. 


ба 100--10%. 


=0,.5= 50%. 


ôa = ex 0.2-10-* = 0.02%. 
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Example 6. Calculate the value of the function y = 1 — cos г 
for the following values of the argument: (1) х, = 80°, (2) т, = 1°. 
Calculate the absolute and the relative error of the result. 

A (1) From the four-digit logarithmic tables we find that 
cos 80° = 0.1736 and, since all the digits of this number are valid, 
we have Ao.1799 = 0. 00005. Then yi = 1 — 0.1736 = 0.8264 and 
Ay = 0. 00005 (from an exact number equal to unity we subtract 


an approximate number with an absolute error not exceeding 
0.00005). Consequently, 
бу, == 0.00005/0.8264 = 0.00006 -- 0.006%. 


(2) We have соз 1° œ 0.9998, А,;ҙ; = 0.00005, y, = 1 — 
0.9998 = 0.0002, Ay, = 0.00005, hence 
бу, = 0.00005/0.0002 = 0.25 = 25%. 


We can see from the examples presented that for small values 
of the argument a direct calculation by the formula y = 1 — cos z 
yields а relative orror of the order of 25%. For z = 80° the relative 
error is only 0.006%. 

We change the calculation procedure and use a formula y = 
1 — cos z = 2 sin? (2/2) to calculate the values of the function 
y = 1 — cos т for small values of the argument. We desi ate 

= sin 0?30' = 0.0087. Then А, = 0.00005, 6, = 0.5/87 

0.58% . Furthermore, 


уз = 2.0.0087? — 0.000151, 
Sy, = 2.0.0058 — 1.2% 
(sce 1.7 below). The final result is 
Ay, = Узду, = 0.000151.0.012 = 0.000002 


(whereas earlier we had Ay, = 0.00005). Thus a simple transfor- 
mation of the computing formula has allowed us to get a more 
accurate result from the same initial data. A 

It is not always possible, however, to transform the 
computing procedure. Therefore, when close numbers are 
subtracted, they must be taken with a sufficient number 
of reserve valid digits (when it is possibbe). If it is known 
that the first m significant digits may be lost and we must 
get a result with n valid significant digits, we must take 
the initial data with m -+ n valid significant digit- as 
was done in Example 5 


1.7. The Error of a Product. The Number of 
Valid Digits in a Product 


The error of a product. Let us consider two exact num- 
bers A, and A, ағ1 their approximate values a, and ay. 
Let A = A,A, and a = aja,. We pose the following 
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problem: being given relative errors ба, and ôu, evalu- 
ate the relative error of the product ё,,. 
We represent the exact values A, and A, in the form 


A, =a, + А, A, = а, + А», (1) 
where the unknowns A, and A, satisfy Шо inequalities 
| Ay |< |а, |8, | Ay IS 1а, | Ôu, (2) 


Multiplying the right-hand and left-hand sides of rela- 
tions (1), we obtain 
414, = аа, + Aja, + A,a, 4- AA 
Passing to absolute values on tlie right-hand and left- 
hand sides of this relation and using the properties of 
absolute values, we find that 


| 414, — аа, |< | Aya, | 4- | Aya, | - 1444,1. (3) 


Since the last term on the right-hand side is small, we 
discard it and divide the right-hand and left-hand sides 





of the inequality by |a | = |а, |. Then, taking rela- 
tion (2) into account, we obtain 
А-а " 

| =E f ba F бл. (4) 





It follows from the relation obtained that we can take 
the sum of the relative errors of the factors 


6, D ба, + би, (5) 


as the relative error of the product а = аа,. 

Inequality (5) сап be easily extended to the product of 
several factors so that if A = 4,44... A, and a = 
ауа, ... Gy, then we can assume that 


ôa == ба -+ ба Tec San: (6) 


In the case when all factors, except for one, are exact 
numbers, it follows from formula (6) that the relative 
error of the product coincides with the relative error of 
the approximate factor. Thus, when only the value of the 
factor a; is an approximate number, then 


б, = б. (7) 
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Remark. When the approximate number a is multiplied 
by the exact factor Е, the relative error of the product 
is equal to the relative error of the approximale number 
а and the absolute error is | & | Limes as large as the ab- 
solute error of the approximate number. 

Indeed, let а = ka,, where k is an exact factor differ- 
еп! from zoro. Then, according lo formula (7), we have 
5, = ба, ог 


4, 
Aa = la] 8, — [a] 8, = [hay] 2 = Jk) Any, 


|41| 
i.e. 
A, = | k | Aa. (8) 
Knowing the relative error 8, of the product a, we сап 
find its absolute error using the formula A, = [a | ôa. 


If the relative error of the product of approximate num- 
bers can be found from formula (6), then, when multiply- 
ing numbers with different relative errors, we may not 
retain the extra digits in the numbers with the smaller 
relative errors. We usually do the following: 

(1) isolate a number with the least number of valid di- 
gils, 

(2) round off the remaining factors so that they would 
conlain one significant digit more than there are valid 
significant digits in the isolated number, 

(3) retain as many significant digits in the product as 
there are valid signilicant digits in the least exact "actor 
(the isolated number). 


Example 1. Find the product of the approximate numbers 
zı = 3.6 and z, = 84.489 all of whose digits are valid. 

A In the first number there are two valid significant digits 
and in the second there are five. Therefore we round off the second 
number to three significant digits. After rounding-off we have 
x, = 3.6, т, = 84.5. Hence 


түту = 3.6.84.5 = 304.20 = 3.0.102. 


There are two significant digits in the result, i.e. as many as 
there were significant digits in the factor with the least number 
of valid significant digits. A 

Example 2. Find tbe product of the approximate numbers 
т = 12.4 and т, = 65.54 and the number >f valid digits in it if 
all the written digits in the factors are valid. 

A The first number contains three valid significant digits 
and the second number contains four. We can multiply the numbers 
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without previous rounding-ofl, i.e. z,z, = 12.4.65.54 = 812.696. 
We must retain three significant digits since the least exact factor 
has the same number of valid significant digits. Thus a = 813. 
Let us calculate the error: 


0.05 , 0.005 
8-6, +5, = тт 54 = 0:041. 


Then Ag = 813.0.0041 = 3.4, This means that the product 
has two valid digits and should be written as A — 813 + 4. A 


The number of valid digits in the product. Consider a 
product of k factors (k< 10) a = оа, ... аһ, where 
a, Æ 0. Each factor contains no less than n valid digits 


(n > 1). 
Assume that each of the factors has the form 


a; = 04-10 -E B, 105 En 1077 4... 
(і--1, 2, ..., k), (9) 
where а; are the first significant digits of the approxi- 
mate factors written in the decimal notation. 


For the relative error of the approximate number which 
has n valid digits we use the formula 


ba =S (1—1, 2, ..., №. 


ац 409-1 


Then the relative error of the product of & approximate 
numbers, eaclf of which has n valid significant digits, is 


0.5 1 1 1 
6, = б, + 64, + eee + блк = ист (ar tut echan . 
(10) 


Taking into account that the number of factors is not 
larger than 10 (Æ< 10), we obtain 


1 1 1 
ota, l edu ©10 


and, consequently, 


0.5 
ôs es - 


4 
Thus, if all factors have n valid significant digits and 
the number of factors is not larger than 10, then the num- 
ber of valid digits in the product is one or two units less 
than л. In the case when the factors have different accu- 
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racy, we must understand n to be the number of valid 
digits in the least exact factor. 

Remark. When the number of factors is large (k >> 10), 
it is convenient to use the statistical estimate which takes 
into account the partial compensation of the errors of 
unlike signs. Now if all the numbers а; (i = 1,2, . . ., k) 
have approximately the same relative error 6, then the 
relative error of the product is assumed to be 


6, = Y n8. (11) 


Example 3. Find the relative error and the number of valid 
digits of the product а = 84.76.8,436, where all the digits of the 
factors аге valid. 

A Here a, — 84. 76, “ay = 8436, пу = ng = 4. Тһе product 
а= 715.03. . . itself begins with the digit 7, i.e. its а = 7. Using 
now formula (10), we find that 


. 05 (2 4) 055 
"ог" at) 74.400 * 


ating this result with the right-hand side of formula (4) 
from ^4 (E we find tha 


0.5 0.5 0.5 
аттас VAR < UAAVABETC 
(7-F 1)- 108) ~ 4-410471 77 (74-1)-10331 
Consequently, the product has at least three valid digits. 

Let us verify whether this is so. We seek the absolute error 
using the formula A, = | с | ô. We get A, = 715,1.0.125 X 
10-3 œ 0.09. It follows that the approximate value of the product 
has three valid digits and, with due account of the rounding error 
of the result, we can write 

А = 715.0 + 0.2. A 


Example 4. Find the relative error of the product a — 145.35 X 
1.24386 and the number of valid digits in it if the numbers are 
given with valid digits. 

A Here a, — 145.35, n, — 5, а, -- 1.24386, n, — 6. These 
numbers have different numbers of valid significant digits. We 
choose n — 5. From formula (10) we obtain 


0.5 
ба- 105-1 (4: )- т-на ` 
Having calculated the product а ае 770.43..., we 


compare the quantity ô, with the right of formola (4) 
from 1.5: 


0.5 0.5 9.5 
(+1) 10 < 7,540681 57) еі. 
Consequently, the product has at lemas three valid significant 
digits. A 
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Thus, in an unfavourable case, the product of approxi- 
mate numbers may have n — 2 valid significant digits 
(where n is the least number of valid significant digits 
of the given factors). 


1.8. The Error of a Quotient. The Number of Valid 
Digits of a Quotient 


The error of a quotient. Let us consider exact numbers 
A,, A, and their approximations а), a, with the abso- 
lute errors Л, and A,,. We pose the following problem: 
evaluate the relative error of the approximate value of 
the quotient a = a,/a, for the exact value A = A/A}. 
Let a, 0, a, -- 0. We represent the exact values of 
A, and A, in the form 


A, == а, -|- А,, А, == 5 + А», (1) 
where the unknowns A, and A, satisfy the inequalities 
[Ar I< Any LAS EE А. (2) 

Let us consider now tlie difference 


Аа a,-|-Ay a /— азд - аА, 


аз Ag аз = аз (а Ag) 
Having divided the right-hand and left-hand sides by 
а, we consider their absolute values: 


азд; — 21А 4: Av Ag 
ау (t2 + Аг) а Ag a, fto 


Bearing in mind that A, is small as compared [о ay, 
we approximately set а,/(аҙ -|- A,) 25 1. Then, using the 
properties of absolute values and inequalities (2), we 
obtain 

| А-а 
а 





А А 
= TA Hoag ба аз. 


[аз | 


Thus we сап take the sum of the relative errors of the 
dividend and the divisor 


6, = бо, + баз (8) 


as- the relative error of the quotient a = a,/a,. 


А _ Ae 


41 4; 
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When we use formula (3) to evaluate the relative error 
of the quotient, the most important contribution to that 
error is from the least exact (having the greatest rela- 
tivo error) numbers. Therefore, when the dividend and 
the divisor have different relative errors, we usually 
do the following: 

(1) isolate the least exact number, i.e. the number with 
the least number of valid digits, 

(2) round off the second number, leaving in it one sig- 
nilicant digit more than there are digits in the isolated 
number, 

(3) retain as many siguificant digits in the quotient as 
there were in the least exact number. 

Knowing the relative error of the quotient, it is easy 
to find its absolute error using the formula 


Aa — |a] 6, = |= 


41 
4а 





(бл, + ба). (4) 





Example 1. Calculate the quotiont a = z/y of the approximate 
numbers т == 5.735 and y — 1.23 if all the digits of the dividend 
and the divisor are valid. Find tho relative and absolute errors. 

A (1) We shall first calculate the quotient. Since the dividend 
z — 5.735 has four valid significant digits and the divisor has 
three, we can carry out the division without rounding-off. We have 
a — 5.735 — 1.23 — 4.66. We havo retained three significant 
digits in tho result since the least exact number (the divisor) con- 
tains three valid significant digits. 

(2) Let us calculate the relative error of the quotien! using 
formula (3) and bearing in mind that A, = 0.0005, A, = Ј.005: 


ба 6-6, = 20908 005 000009 4-0 0041 = 0.0042 & 0.5%. 


(3) We seek the absolute error 
Aa = | а | 6, = 4.66.0.0042 = 0.02. 


With due account of the rounding error 0.005, the final result 
must be written as A = 4.66 + 0.03, Note that the hundred's 
digit is doubtful since 0.03 — 0.005. If we write the result only 
with valid significant digits, we must round it off and take into 
account the rounding error. This requirement is satisfied only by 
the approximate number a, = 5 since А, = Aq + Afounding = 
0.02 + 0.4 = 0.42 < 0.5. | 

At the same time, we cannot leave two valid significant digits 
in the approximate number a since then we would obtain a, = 4.7 
and Ag, = Ag + Abounding = 0.02 + 0.05 = 0.07 > 0.05 А 


8—0104 
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The number of valid digits in the quotient. Let the 
approximate numbers 


a, = 04-105 --a,-10171-. .,.; 
а, =B 10^ +B, 10271. ... 


have n valid significant digits each. Then, using the 
equalities 


0.5 0.5 
ба = тег» баз = (а, 
we shall find the relative error of the quotient а = a,/a,. 
0.5 0.5 
б,-б + Ôa ит + Boe 
0.5 1 1 
= т0л (= + 3.) . (5) 


Consequently, if à > 2 and f, с> 2, then Ше quotient 
has at least n — 1 valid significant digits. Now il a, = 1 
or В, = 1, then the quolient may have п — 2 valid sig- 
nificant digits. 


Example 2. Calculate the quotient a = 39.356 + 2.21 and find 
out how many valid significant digits it contains if all tho digits 
in the dividend and divisor are valid. 

^ (1) Since the divisor has threc valid significant digits and 
the dividend has five, we round off the dividend to four significant 
digits and make the division. We have a — 39.36 -- 2.21 — 
17.81 = 17.8 (wo leavo as many significant digits in the result as 
thero аге in the number with the smaller number of valid significant 

igits). 

(2 We can find tho relative error using formula (5), where 
n = 3 since tho least exact number has three valid digits; а, = 3, 
В, -= 2. Consequently, 


0.5 (1,1 5 - . 

ва = тт (5+5) == 1271! 2—10,42^$. 
Comparing the quantity 6, with the right-hand side of formula 
(4) from 1.5, wo obtain 


0.5 0.5 0.5 
UFD IT 12-4053: © (141) 4083 * 
Thus tb: quotient contains at least two valid significant digits, 
i.e. one significant digit less than the approximate number (the 
divisor) with the smaller number of valid significant digits. A 
Example 3. Find the relative error of the quotient a—15.834 — 
1.72 und the number of valid digits in it if the dividend and divisor 
have valid significant digits. 
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A The least exact number has three valid significant digits. 
We shall seek the relative error using formula (5): 


0.5 74 , 1 0.5.2 
arti) aw 


Calculating the quotient a = 9.20 and comparing the quantity 
6, with the right-hand sido of formula (4) from 1.5, we find that 
the quotient contains only one valid significant digit, i.e. two 
valid significant digits less than the least exact number. A 


1.9. The Errors of a Power and a Root 


Consider an approximate number a, which has a rela- 
Live error би. Assume that we have to evaluate the rela- 
tive error of degree а = ат. Evidently, 


а--ат- аа... Q4. 





m factors 
The relative error of the product is 
65:05, 4- Sa, -- ... 4-09, = mÓ,. (1) 
m terms 


Thus, when we raise the approximale number a Lo 
the power т, its relative error increases т times, іп prac- 
Lical calculations, when we raise an approximate num- 
ber to a power, we leave as many significant digits in the 
resull as there were in the approximale number itself. 

Example 1. A side of the squaro а = 36.5 cm (with a» ^«:curacy 
to 1 mm). Find the area of the square, the relative and thc solute 


error and the number of valid digits in the result. 
A (1) We calculate the area of the square: 


s = а? = 36.5% = 1332.2 = 1.38.10? cm?, 
(2) We seck the relative crror of the area: 


0. "EN 
б, = 28,— 2. ggg e 0.0055 = 0,55%. 


(3) Now we seek the absolute error of the area: 
Ag = 56, =- 1.33-10?- 0.0055 = 7.4 cm?, 
With due account of the rounding error, we сап write the final 


result as 
s = (1.33 + 0.01):0103 m’. 


Thus the result has two valid significant digits. A 
Note that in the broad sense the result of Example 1 has three 
valid significant digits. 
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Let us consider an approximate number a, which has a 
relative error 6,,. We can show that the relative error of 
the number а = Ч/а, is m times as small as the relative 
error of the number a,: 


+ б. (2) 


б. == 

In practical calculations, when we extract а гоо! of 

an approximate number, we leave as many significant 
digits in the result as there were in the radicand. 


Example 2. Find out with what relative crror and with how many 
valid significant digits we can calculate a sido of the square if its 
area s = 16.45 cm? with an accuracy of 0.01. 


А We have a= V s=4.056 сш; 


1,241,004 
2 * 2 46.45 


Ал = 4.056 -0.0003 = 1.8: 40-3, 


Thus, with duc account of the rounding error, we һауе A -- 
4.056 + 0.002 cin and the number of valid significant digits is 3. A 


ôa = = 0,0003 — 0.03%; 


1.10. The Rules of Caleulating Digits 


There are certain rules for calculating digits which 
should be used whenever the calculation of the error may 
not be strict. These rules show how all the results must be 
rounded off in order, first, to ensure the specified accuracy 
of the final result and, second, to obviate calculations 
with extra digits which do not affect the valid digits of 
the result. 

Неге are the rules of calculating digits. 

1" When adding up and subtracting approximate num- 
bers, wc must leave as many decimal digits in the result 
as there are in the approximate number with the least 
number of decimal digits. 

2°. When multiplying and dividing approximate num- 
bers, we must retain as many significant digits in the re- 
sult as ‘here are in the approximate number with the 
least number of valid significant digits. 

3°. When we square or cube an approximale number, 
we musl retain as many significant digits in Lhe result 
as there are in the base of the power. 
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49, When we extract a square or cubic гоо! of an ap- 
proximate number, we must retain as many significant 
digits in the result as there are in the radicand. 

5°. When calculating intermediate results, we must 
retain one digit more than rules 19-47 recommend. 1n 
the final result this "reserve" digit is dropped. 

6°. If some data have more decimal digits (in addition 
ind subtraction) or more significant digits (in other oper- 
alions) than other data, they must be first rounded off, 
with only one "reserve" digit retained. 

72, When we use logarithms to calculate a one-term ex- 
pression, we should calculate the number of significant 
digils in the given approximate number which has the 
least number of significant digils and use the table of 
logarithms which has one extra decima! digit. In the final 
resull we drop the last significant digit. 

8°. If we шш take the data with an arbitrary accuracy, 
then, to obtain a result with m valid digits, we must (аке 
(he initial data with the number of digits which, accord- 
ing to the preceding rules, ensure m -|- 1 digit in the 
result. 

We present these rules on Ше assumption Lhat tlie com- 
ponents of Ше operations contain only valid digils aud 
the number of operations is nol large. 


ив 
С? 


B: 50.46 + 0.02, С--15.4-- 0.03. Find the error of the m ult. 

A When we calculate the intermediate results, wo shall retain 
one "reserve" digit, i.e. if, according to the general rule we must 
retain п significant digits, we shall retain n -+ 1 digits in the inter- 
imediate results. We have 


Example 1. Calculate X — , whero 4--7.45 4 U.01, 





г .5.7.1035 
a = 413.5, b=7.1035, c?= 2372, ze 0 44. 


We have left threo significant digits in the result since tho least 


number of significant digits in the factors is 3. 
We calculate the error of tho result: 


Е 0.04 , 4 0.02 
б-3044-: 6 2037; 7d y 50.46 
0.03 


5.4 


& 0.0044 4-0 0002 -- 0.004 e 0.009; 
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Ax = 12.4.0.009 = 0.12. 


The answer із X = 12.4 + 0.12, 6, = 0.9%. A 


or , Where А--2.754 + 0.004, 


= 11.7 + 0.04, M = 0.56 + 0.05, С = 10.536 + 0.002, D = 
632 + 0.008. Find the errors of the result. 
A We find that 


e b = 2.75 + 11.7 = 14.45, 
бач, = Ag: -|- Ap Aroundipg, = == 0.001 + 0.04 -|- 0.004 = 0.045, 


Example 2. Calculate X — 


с—@ = 1 CLADE EL: 216; heey Т? 1. 0.008 — 0.010. 
Therefore 
14.49.0.56 14.45-0.56 
= L == I) =I - 
r= p yg 0.456 2: 0.46 = 4.6.1071 
0.045 | 0,005 a 0.01 
бх 48 - 0.56 7 4.246 


== 0,00344 4+ 0.00894 + 0.00474 == 0,02 =: 2%, 
Consequently, 
x = 0.46-0.02 = 0.01. 


Thus the result is X — 0.46 + 0.01, 6, = 2%. 
Example 3. Using the rules of calculating digits, conipute 


h 
v= mth? (r—3) , 
where h = 11.8, x = 3.142, r = 23.67. 
A We find that 
v = 9,142.11,8% (23.67 — 3.933) = 3.142-11.8%019.737 
= 3,142. 439, 2.19.1737 = 437.37-19.737 = 8630 = 8.63. 109. A 


Exercises 


1. Carry out the successive roundings-off of the following num 
bers: (а) 2.75464, (b) 3.14159, (c) 0.56453, (d) 4.1945, (е) (1.60653. 

2. Rounding off the following numbers to three significant 
digits, find the absolute A, and the relative (in per cent) 5, error 
of the resulting approximations: (a) 1.1426, (b) 0.01015, (c) б. 1245, 
(4) 921.55, (е) 0.002462. 

3. Find the absolute error А, of the following : approximate 
numbers proceeding from their relative error: (а) х= 2; 52, 6, 
0.7%, (b) = := 0,986, 6, = 10%, (с) z= 40.75, = — 1%, 
(4) ёт 199.1, 6, = 0.01, "te) z — 0.86341, Se eC ШЕ” 

Find the number of valid significant digits for the following 
арра numbers: (а) 39.285 + 0.034, (b) 1.2785 + 0.0007, 
(с) 183.3 =- 0.1, (d) 0.056 +. 0.0003, (e) 84.17 + 0.0073. 

5. Find out which of the following two equalities is more exact: 
(а) 6/25 = 1.4 ог 1/3 = 0.333, (b) 1/9 = 0.1 ог 1/3 = 0.33, 
(с) 15/7 & 2.14 er 1/9 e 0.11, (d) 6/7 = 0.86 or n = 22/7, (e) л = 
3.142 ог V 10 = 3.1623. 
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Hint. First find the relative errors. The equality whose relative 
error is smaller is more exact. 

6. Round off the doubtful digits of tho number A = 47.453 + 
0.024 leaving valid digits in it. 

7. Round off the doubtful digits in tho number A = 46.3852 + 
0.0031 leaving valid digits in it. 

8. Round off the doubtful digits in the approximate number 
а = 3.2873 if 6, = 0.196, leaving valid digits in it. 

9. Find the relativo and tho ahsolute errors of the following 
approximate numbers if they have only valid digits: (a) a — 
0.7538, (b) a — 17.354. 

Hint. Use formula (3) from 1.5. 

10. Calculate the following expressions and evaluate their 
errors. In tho answer retain all valid digits and one doubtful digit. 
Al the numbers are given with valid digits: 


(a) y= 307326 p) y 36-25-85 
9-64-98 (Р) Y= 975.672 ' 

| 37.24+458.67 | 96.891—4.25 
(с) у= 736:5.246 > (9) 9— 33.3-|-0.426 * 


11. Using the rules of calculating digits, compute: 
_ L? a?-L ab 4- b? 
(а) 5g ^ (ar by 





, whero %= 2.73, а--0.452, b 0.328; 


(b) s-= $ n (a-b), where а == (0.937, b = 0.0630. 


Chapter 2 


Matrix Algebra and Some Data 
from the Theory of Linear 
Vector Spaces 


2.1. Matrices and Vectors. Principal Operations 
Involving Matrices and Vectors 


А rectangular array which is composed of elements 
(numbers in special cases) and has m rows and n columns 
is a matrir of dimension m X n, or an m X n matrix. 
The elements of a matrix are designated as a;;, where i 
is the number of the row and j is tho number of the column 
whose intersection is occupied by the element. 

For instance, 


441 033. Rig ... Gin 


49; 253 Asg ... Оп 

А--| аз азу аз . Gan 
MED 

amı Üma3 Ima amn 


is an m X n matrix which has m rows and » columns. 
The abridged notation of the matrix is A = [aj], 
where i = 1, 2,..., т, ј = 1, 2,..., п, or lajjlnn». 
If the number of rows in a matrix is not equal to the 
number of columns, i.e. m Æ n, then the matrix is called 
rectangular. 
A matrix which has only one row, i.c. т = 1 is a 
row matriz (or row vector), for example, 


A = (4,41 |d or А = [4 2 3 4l. 


A matrix which has only one column, i.e. n = 1, isa 
column matriz (or column vector), for example, 


411 . 
аз 

А == М ог А шш . 
mı 


ak о = 
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In what follows, we shall call a row matrix or a 


Ti 

T3 
column matrix a vector and designate it as x= 

Zn 
ог аз х —[z,25,..., Zal. The numbers ху, £z, .. ., Zn 


are the coordinates (or elements) of the vector х. Since the 
number of coordinates of a vector is, by definition, ils di- 
mension, the veclor x is n-dimensional. 

If the number of rows in a matrix is equal to Lhe number 
of columns, і.е. m = n, the matrix is square. A matrix of 
this kind can be written in the form 


411 815 ... Gin 
421 492... Gan 


A= 


Ярі 412... Onn 


For a square matrix the total number of rows or columns 
is called the order of the matrix. 

The principal diagonal of a square matris is the diago- 
nal extending from the upper left to the lower right cor- 
ner, i.e. a set of elements of the form a, where i = 
1,2, ..., n. 

A square malrix in which all the elements which lie 
outside of the principal diagonal are zero, is called а 
diagonal malriz. ''his matrix has the form 


ay, 0 0...0 
0 аза 0...0 
А--|0 0 agy...0 . 


0 0 0...а 
A diagonal matrix all of whose elements on the princi- 
pal diagonal are equal to unity is an identity (or unit) 
matriz. An identily matrix is designated as J and has tho 
form 
4100... 0 


010... 0 
= 004..01 
000... 4 
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The index r indicates the order of the identity matrix. 
In matrix calculation the identity matrix plays the part 
of unity. 

A square matrix all of whose elements are symmetric 
about the principal diagonal is a symmetric matriz. 
The equality a,; = aj; (i = j) holds true for a symmetric 


matrix. For example, 
124 
A- |: 3 | 
456. 


is a symmetric matrix. 

А matrix all of whose elements are zero is a zero, or 
null, matrix and is designated as 0. If we have to indi- 
cale the number of rows and columns, we write 


09... 0 
0 0 n 
Omn = . ев. o 
оо 0 


Two matrices A = [a;j] and В = [bj] are equal if 
(1) they are of the same dimension, i.e. the number of 
rows of the matrix А is equal to the number of rows of 
the matrix В and the number of columns of tlie matrix 
A is equal to the number of columns of the matrix В, 
(2) the respective elements of these matrices are equal. 
Thus, if 


411 3 Cin bi бо bin 

A азу 6%; day B boy ba ben 
, LI 

ат Oma >... mn bmi Oma ... bmn 


апа a; = бі; (i = 1, 2,...,m,jf 4,2,..., п), Шеп 
B 


The sum of two matrices of the same dimension A -+ 
B = [ayy] + [by] (6 = 1, 2,..., т, j = 14, 2,..., n) 
is a matrix C = [c;jl of the same dimension whose ele- 
ments с;; are equal to the sums of the respective elc- 
ments а); and b,; of the matrices A and В, i.e. cj; = 
а + бі ‘ t 
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The difference of matrices is defined by analogy with the 
sum of matrices with the only difference that the signs of 
the elements of the subtracted matrix are changed to the 
opposite, о. D—A— B, dij = lij — bij (i = 1, 2, 

.,m, j21,2,...,n) 

The product of the matrix A = [a,j] by the number a 
is a matrix whose clements result from the multiplication 
of all the elementis of the matrix A by the number 0: 


«а, ша; ... Ain 
Ade, 0422 ... Adan 
ad= 


The matrix —A = (—1) A is the inverse of the matrix А. 
The additi," of matrices obeys the following laws: 
4) A 4- (B + C) = (A + 8)4 C, (2) A + B= 
B.|- A, (3°) A +0 = A, (4°) A 4- (—A) = 0. 

The product of a matrix by a number obeys the fol- 
lowing laws: 


(1°) 1-A =A, (2°) 0:А -0, (3°) œ (DA) = (ap) А. 


Example 1. Assume that 


1 234 1-4 2--7 
—2 045 4 3—2 —4 
А=| т g412|* ?=l4-6 0-4 
1 —143 2 3 4-5 
Then 
215 —3 о 3141 
Е | 2332 1] „_ 2-66-36 9 
С--4--8-| воя а P-4—?-|.s 913 
| 328 —2 —1 —40 8 
Example 2. ‘The product of tho matrix 


1 43-4 
A= 01-2 
-81 5 


by the number 2 is a matrix 


26 —8 
2A= 02 —4|. 
—62 10 
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Тһе product AB of iwo matrices 


411 біз ... Gin ba Әз... д 

аз 42 ... Gan bay bas bz 
A= and B= 1 

Umi m2 +++ amn bni bno ..- bng 


which havo dimensions m x м and n X q respectively, 
is à malrix 


Cmi Ст2 +++ Cmq 


of dimension m X q. Note that the matrix C = AB 
is defined only when the number of columns of the matrix 
А is equal to the number of rows of the matrix В. 

The elements of the matrix C can be calculated accord- 
ing to the following rule: to obtain the element cj; which is 
in the ith row and the jth column of the product of two mat- 
rices, the elements of the ith row of the first matrix must be 
multiplied by the corresponding elements of the jth column 
of the second matrix and the resulting products summed up: 


€4577 айлу} 40) d «cb аба 
(і = 1,2,...,т,) -1,2,...,4). 


For example, сз = абу, F 55044 -...-1- duabus 


Ca = 44401 + арда 52... -| 4,4044 etc. 
2-4 
8 281 1-3 
Example 3. лв- | —_—40 al 0 4 
3 1 


| [3-2--244-E8-0--1-3.— 3(—1)4-2«(—8)--8:1--141 
-[i даавар а 9 4044:34] 


-[5 а]. 


Here AB = [aj Јах ‘(be jlaxa= C = [ei а.з. 
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Example 4. 


123 1 1:1-|-2-2--3.3 14 
456 2|—|4-14-5.2--6.3|--| 32]. 
789113 7-1:-8.2-9.3. 50. 


Here АВ--(а4/ 3 [5ij]5.1— [сг 3]зх1- 
Example 5. 
лв= |» A Е sl [35524 ҰНЫ 21 
84 78 8.5-|-4.7 3-6-| 4.8] |4350)” 
5 М 1 я . 5.1-1- 6:3 ЖЕР 6] 
78 34 7.14-8:3 7-218-4 34461” 
i.e. AB +Æ BA. 


BA— 


123 3247 

Example 6. Tho product АВ= |, 5 3 213 
7 [TEMA 1.2. 
deep 3-4 6-4 4-2 


does not exist since the number of columns of the matrix A is 
uot equal to the number of rows of the matrix B. 


The product of matrices obeys the following laws: 
(1°) А (ВС) = (AB) C, (2) « (AB) = («A) B, 
(3°) (A -- B) C = AC q| BC, (4°) EA = A. 


Note that AB Æ BA, i.c. in the general case (ne pro- 
duct of two matrices does nol possess the property of 
commutativily. The only exceplion is an identity matrix. 
AI = [A = A. This means that in the general case we 
cannot interchange the factors without changing the pro- 
duct. When we change the order of the factors, it may 
turn out that it is impossible to carry oul the multipli- 
cation at all (see Example 6). 

We say of the product AB of two matrices A and В 
that the matrix В is premultiplicd by 'he matrix A and 
the matrix A is postmultiplied by the matrix В. 

The product of several matrices ABC must be under- 
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stood as follows: the matrix A is postmultiplied by the 
matrix B and the resulting matrix is postmultiplied by 
the matrix C, etc. The number of multiplied matrices 
may be arbitrary, the only condition being that two adja- 
cent matrices can be multiplied. 

The matrix A?” is the nth power of the matrix A. If 
A is a square matrix and n is a positive integer, then 


А A-A-A... А. 


т factors 





Тһе operations of addition of column matrices and row 
matrices (i.e. vectors) and multiplication of them by sca- 
lars are similar to the corresponding operalions involv- 
ing square matrices. Thus the sum of two vectors x = 
[arp ... Zn] and у= [00у ... Yn] is a vector z = 
[2125 .. . 211 with the coordinates z, = 2, -|- yi, Zs = 
Za -H Ya ee ey Zn = Zn b Yn, the product of the vector 
х = [TT ... z,] бу the scalar a is а vector z= 
ar = lar, ат, ...az,). 


Example 7. The sum of the vectors х= [1 2 3] and y- 


[—5 —2 4] is a vector z=[—4 0 7]; the product of the vector 
1 27 
-| 2| by the scalar а == 2 is a vector z— 4 
— 3, —6. 


2.2. Transpose of a Matrix 


If we replace the rows of the m X n matrix 


ау Gja ain 
A ај Beg ün 
ату 4т2 ... Amn 


by the corresponding columns, we obtain an n X m 
matrix 


ац 0:2 аті 

т ај 4% ame 
A — , 

.72........ 

Qin üz .. Amn 


which is known as the transpose of the matrix A. 


Ch. 2. Matrix Algebra and the Theory of Linear Vector Spaces 47 


Example 1. The transpose of tho 3X 4 matrix 
12-35 
А-|20 42 
12 34 


2 
0 


1 
2 
43 
24 


is a matrix 


1 
T. 2 
^ =| 3 

5 
of dimension 4 x 3. 

Example 2, The transpose of the row matrix В--И 2 3 4] is 
1 
2 
ak 
4 

Note the following properties of transposition. 

1°, If we transpose Lhe matrix A twice, it will remain 
unchanged: 


a column matrix BT = 


(AT)T = А. 


2°. The transpose of the sum of two matrices is equal 
to the sum of the transposed matrices: 


(А + BY? = AT + BY, 


This follows from the definition of the sum of two matri- 
ces. 

3°. The transpose of the product of two matrices i- »qual 
Lo the product of the transposed matrices taken in the 
Teverse order: 


(AB)? = BTAT, 


The matrix (AB)T has resulted from Ше multiplication 
of the elements of the rows of the matrix A by the ele- 
ments of the columns of Lhe matrix B followed by the 
replacement of the rows by the columns. We can get the 
same result if we mulliply Lhe elements of the columns 
of the matrix B (the rows of BT) by the elements of the 
rows of the matrix A (the columns oi 4T). 
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2.3. The Determinant of a Matrix. The Properties of 
the Determinant and the Rules of Its Calculation 


Let A be an arbitrary square matrix of order n: 


ау Gja аһ 
421 4: aan 

A = . 
ânı na апп 


The matrix A is associated with a determinant which сап 
be designated as d, D, det A or | A |: 


üil ауз ... Ain 


d=D=detA-|A|-=|"™ 7°" |, у 


nı 8,2... Ann 


The determinant of a matrix is a number which can be 
calculated in accordance with certain rules considered be- 
low. 

There are two diagonals іп a determinant, a principal, 
or leading, diagonal and a secondary diagonal. Тіс 
principal diagonal of a determinant, as that of a square 
matrix, consists of the elements a,;, where i = 1, 2, 

., n. The secondary diagonal is perpendicular to Lhe 
principal diagonal and passes from the upper right. cor- 
ner of the determinant to its lower left corner. The order 
of a determinant corresponds to the order of the matrix 
with which it is associated. 

If the order of a matrix is unity, i.e. the matrix consists 
of one element a,,, then the first-order determinant asso- 
ciated with this matrix is a number equal to that cle- 
ment. 

Consider a second-order square matrix 


-[2 аз | 
йз dag |" 

The .econd-order determinant corresponding to this 
malrix is a number 


det А |а өз 


gj (оз 





= 044053 — 0,0,4. (2) 
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Formula (2) gives the rule of calculating a second-order 
determinant: a second-order determinant is equal to the 
product of the elements of the principal diagonal minus the 
product of the elements of the secondary diagonal. 


Example 1. Calculate the determinant of the matrix А- 
12 
(4 s] t 
12 
^ det л--|, 5 m45-42--.3. А 


A third-order determinant is à number 


411 412 013 
del А- | 221 49; 023 
зү 032 033 

= 044055033 — 044305403, |: 1,490,303, 


70440,5044 — (0544044033 — (43033044. (3) 


Thus ecery term of a third-order delerminant is the pro- 
duct of three of tts elements, taken one from each row and 


ан Qo Qiz An (12 dia 
SONOS 23 аж Say, 23 
аз, [> Vn (135 а, M N Азз 
Fig. 2.1 Fig. 2.2 


each column. These products are taken with definite signs: 
three terms consisting of elements of the principal diagonal 
and of the element which are at the vertices of isosceles tri- 
angles with the bases parallel to the principal dtagonal are 
(акеп with the plus sign (Fig. 2.1); three terms which осса- 
py similar positions relative to the sevcudary diagonal are 
(акеп with the minus sign (Fig. 2.2). This rule is known as 
the rule of triangles. 


4-0104 
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Example 2. Calculate the determinant of the matrix A— 


12 3 
ЕЕ! 
21 2 








12 3 
A det A—| —4 5 —1|—1.-5.24-3-4«(—4) -2«(—1)-2 
21 2 
—2.5.3—1.(—1)-4—2.(—4)-2— —19. A 


Let us consider now a determinant of any order п, 
where n> 2. To calculate such a determinant, we must 
introduce the concepts of a minor and a cofactor. 

The minor of the element aj; of a determinant of order 
n (1) is a determinant of order (n — 1) which can be ob- 
tained from the initial determinant by deleting the ith 
row and the jth column (the row and the column whose 
intersection is occupied by the element а;)). 

The minor of the element а;; is designated as Mj;. 
The first index here denotes the number of the row and 
the second, the number of the column which are deleted. 

For instance, in the third-order determinant 


а- 


4ҙі 444 43; 


411 013 a 
азі 033 033 





the second-order determinant 


431 43 
Gg das 


Ма- 








is the minor of the clement а,,. 
The cofactor, or algebraic adjunct, of the element aj; 
of the nth-order determinant (1) is a number 


41(— 1) My). 


Evidently, if the sum i + j is even, then the cofactor has 
the same sign as the minor, now if the sum i 4- j is odd, 
then the sign is changed to the opposite. 

Theorem 1. A determinant is equal to the sum of the pro- 
ducts of the.elements of any row (column) by the corre- 
sponding cofactor: 
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411 41 ain 

a a a 
det A= 21 22 2n 

anı äna ... ann 


= 0444-0151, ]- ... +A, Ain = 2 аА 
= 
(i=1, 2, ..., n) (4) 


or det A= ajA tH as; Aj +... + 454445; 
n 
^ У аЛ, ( 7:4, 2, ..., n). (5) 
i=1 


Formula (4) is the expansion of the delerminant according 
to the elements of the ith row and formula (5) is the expan- 
sion of the determinant according to the elements of the jth 
column. 

When we expand a second-order determinant according 
to the elements of any row (column), we get formula (2) 
given above, and when we expand a third-order deter- 
minant according to the elements of any row (column), 
we get formula (3) (the rule of triang!es). 


Example 3. Calculate the determinant 4-13 A by expanding 


it according to the elements of the first row. 
A According to formula (4) we have 
d — 811411 012412. 
Since A,,—(—1)!1.4—4, Ау —(—1)*?-3:- —3, we hav d— 
1.44-2(-3)---2.4 
3 21 


Example 4. Calculate the determinant 4--|2 5 3], expanding 
3-12 
it according to the elements of the second column. 
А From formula (5) we get d--a,54,3-]-a99422-1-232/;3. Next 
we find that 








ла |$ 5|7 - 9-5 
1 
Aga = (—1)?*? 32|-9—3-5 
An (0388 |3 3 |= — (0-2) т 





whence d—2-5-+5-3-|-4(--7)+-—3. A 
qn 
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Theorem 2 (corollary of Theorem 1). // ail of the ele- 
ments of the ith row (column) of the determinant d, except 
for one, say, a,n, are zero, then the determinant is equal to 
the product of the element аң by its cofactor, i.c. 


d == аА. (6) 


Example 5. Calculate the fourth-order determinant 
11 3 4 

40 0 4 

30 uU 212 
ав-5-.44 


expanding it according to the elements of the second column. 
A Since aj, T ар aqg- 0, we find from formula (6) that 


d -— 





1 Ü 4 
d=- 843449 14: ( — 1)1*? 3 0 2 1 
0 --5 —11 





whence, again expanding the resulting third-order determinant 
according to the elements of the second column, we obtain 
141 
82 

Theorem 3. The sum of the products of the elements of a 
row or a column of a determinant by the cofactors of the 
corresponding elements of the parallel row (or column) 
is zero. ° 

Thus, for the third-order determinant 


d= —(-—5)(—1)" -—5(2—12)—959. A 





411 012 013 
0821 255 424 
4ҙі 035 азд 





there hold equalities а,141 -- 45544, + 255443 = 0, 
0314 21-]- 4354 z 4- 0434,34 == 0 and so on. 

Неге are the properties of the determinant. 

1°. The determinant does not change upon transposition: 


441 40... Gin аур 4941... Any 
Jet А — 831 4299 ... Aan — ауз 492... mo 
Qni nz > Ünn Gin Mn >... lnn 


This means that the rows and the columns of a determi- 
nant are equivalent. 
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IL follows from this property that the determinant of 
the matric A is equal to the determinant of the transposed 
matric АТ, 


For exainple, 














12 3 1-42 
det A—| —4 5 --1|-—|2 51 
21 2 3 12 
45:2 З) ЕЗ 1-2 3-5-2 be -1)4 
Ha Be(- A) Des --19. 


27. Tf one of the rows or one of the columns of a determi- 
nant consists of zeros, then the determinant is equal to zero, 
For example, 
oo 1 2 
0 3 4 
0 10 45 
:iU:3-105-L0:1.4 270-2: 10 —0.3.2 
—10. 115-0. 4.10 — 0, 


det A= 








3°. When two rows or two columns are interchanged, the 
delerminant only changes sign. 


For example 





1203 
аА 24002 
--4 5 --4 

— Ed(— D-22364) Б2-5-ә-3-1-(--4) 


-5.2.1 -22 (-—-1) -19 
(compare with the example which iiustrated property 1°). 


А”. A determinant which conlains two identical rows or 
two identical columns is equal to zero. 


For example. 


423 
det A 123[|.-b2-24 23-24 043 -23-2:3 p 233—430, 
212 


59, IJ all the elements of a гош ог a. Читп of a deter. 
nant are multiplied by the scalar k A, then the determi- 
nant itself will be multiplied by that scalar. 
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Here is another formulation of this properly: the com- 
mon multiple of all the elements of some row or some co- 


lumn can be taken outside of the sign of the determinant. 
For example, 








36 9 12 3 
det A=| 21 2| =з 21 2|=3.19—57 
—4 5 —1 —4 5 —1 





(compare with the oxamplo which illustrates property 39). 


4°, A determinant which contains two proportional rows 
is equal to zero. 


For example, 


369 123 
det A==/1 2 3|=3|1 2 3)=3-0=0, 
212 212 














79. If all the elements of the ith row of an nth-order deter- 
minant are represented as the sum of two terms, i.e. aij = 
bij -- c, == 1,2,..., п), then the determinant is equal 
to the sum of two determinants in which all the rows, ex- 
cept for the ith row, are the same as those of the given deter- 
minant, and the ith row in опе of the lerms consists of the 
elements 0); and in the other terms, of the elements сұр 


det A 


011 419 13 ... Ain 
03, == byg- 691053 — бұзба — brat Сад >>. dan — Pon FCn 

== | 03i Ayo 133 ‚+. бац 
Oni ат; ana Gun 

411 41; аз ain 811 а, 813 ain 

ba ӛз Ба bon Cor Со) Сәд Can 

= | 491 G32 33 bsn |+| 4зі даз Fan а 

42.2... 2.....|0|)...4........ 

Oni nz Gna -++ ann Uni ana na ... Onn 


For example, 

4 
4 
2 


1 
4 
1 
8°. Tf one of the rows of a determinant is the sum of some 


other rows or the sum of the products of some other rows of 
the determinant by the scalar k, then the determinant is 


3 145 
det A= =143 4/1/13 4|=0—1-= —1. 
ü 102 
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equal to zero. (This follows from properties 6° and 7° 
of a determinant.) 


For example, 





123 123 123 
det 4= [3 2 7|—|12 3| -2|1 0 2|2:04-2-0 50. 
102 102 102 

















9°, The determinant will not change if the elements of 
one of its rows (columns) are summed up with the corre- 
sponding elements of some other row (column) multiplied 
by the same number. 
279 
134 
102 
illustrates property 7%. We multiply the third row by 3 and sum 
up with the second row. We obtain 
127 9 
det A—14 3 10 
10 2 
22.8.2-]-1.7-40-L4-0-9— 1-3-9—4. 7-2 — 2.0.10 = —4. 
Using these properties of a determinant, we can sim- 
plify the calculations of au ntli-order determinant. Trans- 
formations which do not alter the value of a determinant 
are said to be elementary. 
Example 6, Calculate the determinant 


11 1 1 
—12 3 4 
—23 610)’ 
3 4 19 20 
expanding it according to the elements of tho first column. 


А According to formula (5), d=a; An l-a1421-- 031431 + 
4414,41. We seek the cofactors. We have 


For example, det A= = —1 (see the example which 











а-- 














234 232 
Ay -C-1)-|3 6 101252.2]3 6 5 
4 40 20 255 
65 32 32 
— Al: —al? | =4(2-5—3-5-42-3) 24. 
-4(2|5; з 215 sl) 4(2.5-3.5--2.3)--4 














We have pul the common multiple 2 :* the third row aud the 
common multiple 2 of the third column beluro the sign of the deter- 
minant A,, and then expanded the resulting determinant according 
to the elements of the first column. 
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Wo calculate 


111 14 1 
Az 7(—1)9913 6 10|2 —2,3 6 40 
4 10 20 2 5 10 














6 10 3 10 36 . . А 
= -2( 5 iol- 2 "Tu 25 ) = —200—104-3— =6. 


We have put the common multiple 2 of the third row before the 
sig of the determinant and expanded the determinant according 
to Ше elements of the first row. 

By analogy we obtain 


1414 14 4 
Ay (C-19|2 3 4|-22|23 4 
4 10 2) 2510 

















) 


-2( 3 4| |2 H 23 
- 5 10 2 1! | 25 
= 2 (40 —124-4) — 4; 

11 1 


23 4 
3 6 10 


3 4| |2 4 
-— (fo ла |3 10 


Expanding the determinant A according to the elements ol the 
first column, we finally obtain 


= 4-4 -|- (—1)+(--6) -F (72-4 + 3:0—1) — A 
We can considerably simplify the calculation of a de- 
terminant if, using the properties of (he determinant, 
we transform it so that formula (6) can be used in calcu- 
lations. 


Аа (—1)4 








23 ош. 
- là б ) = —5+в8—3— --1. 





Example 7. Calculate the determinant 


11 1 1 
—12 3 4 
—23 61! 
3 4 10 2! 
using el. шошагу transformations. 

A Using the elementary transformations of a determinant, 
we turn all the elements of the first row, except for а) - 1, into 
zero. lor that purpose, without changing the first column, we 
multiply all of its elements by (—1) and add successively to the 


d= 
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second, the third and the fourth column. Wo obtain 


11 1 1 1uu a 

des —12 3 4) |434 

—23 0 10| |158 

3 4 410 29 117 
34 5 
== 1.(—1)1*1[5 8 12], 
1717 


In the resulting third-order determinant we again turn all of 
the elements of the third row, except [or the first, into zero. For 
that purpose, without changing the first column, we multiply it 
consequently by (—7) and (—17) and add successively to the second 
and the third column. We expand the resulting determinant accord - 
ing to the elements of the third row: 


3 —17 —40 
—17 —46 
=|5 --27 --732|-- 4. (-- fy! oL 
d 9 2 3 1-(--1) | 97 —13 1. A 





2.4. The Inverse Matrix 


A square matrix is said to be the incerse of a given square 
malrix if its premulliplication and postmultiplication by 
(he given matrix yield ап identity matris. The inverse 
of the matrix A is designated as A. By delinition, 


AA C o АЗА = f. (1) 


A square matrix is said to be nonsingular (теегі е) 
if its determinant is nonzero. Now if the deleri. nant 
of the matrix is zero, then the matrix is singui r (or 
noninvertible), 

Theorem. For the square matric A to have an inverse, 
il is necessary and sufficient. that the determinant of the 
matrix A be nonzero, i.e. that the matria A be nonsingular. 

The process of nding an inverse of a matrix is known 
as the aversion of a matrix. 

Let us consider the process of the inversion of a matrix. 


Let 
ауу Ua. >> din 
б, 4а,» vee Ay, 


А. 
алі Ong e Wu 
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be a nonsingular square matrix of order n whose deter- 
minant d Æ 0. We compose a matrix of the cofactors of 
the elements of the given matrix and then transpose it. 
'The resulting matrix is known as an adjoint, or conjugate, 
matrix with respect to the matrix А and is designated as 


А: 
Ау, Ад... Any 
~ Ay, A 4 
A= із 22 na . (3) 
Ant Ana Ann 


Calculating the products AA and AA according to the 
rules of multiplication of matrices, we obtain 


AA = AA = dl. (4) 
[1 We shall prove the validity of equality (4) using 
Ше example of a third-order matrix. Assume that 
“diy 013 біз ~ Ay: Agi Agi 
А--| а 4» a] and A= | Aig Avg Аз |. 
431 4ҙҙ 433 Аз Aga Аза 
Then 
` ayirt 29154157 212415. 011451 12423 
AA = | anA 2541, T 234413. 03143 F 225455 
031/11 d-432415-- 0353435. 231451 + 433452 
Fais 011431 dl 2912422 - 215423 
--аҙзА;) 441431-Ғ4;; Аҙ) t 023/53 | . 
T-a G3 Agi + 035433 -Раҙа аҙ 
In accordance with Theorem 3 from 2.3, all the ele- 


ments of the product АА, except for tlie diagonal ones, 
are zero. Consequently, 


~ favo 100 
АА = 10401 (0101-4. 
00d „01 


We сап show by analogy that АА =dl. WM 
Since AA =: AA = di, with d Æ О, it follows that 


A 


aj> 


А AL 
=f 4A=l. 
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On the other hand, by the definition of the inverse mat- 
rix, we have 


АА! = АЗА = Г. 
Comparing the last matrix equalities, we get а formu- 
la for seeking the inverse matrix: 


~ 41/42 Agy/d А,4/4 
A^ = A/d — 41/4 Аҙҙ/4 Ag /d 
A1a/d. А,ҙ/4 Asg/d | 


In the general form, the inverse of a nonsingular square 
matrix of order п can be calculated by the formula 


A/d А,/4 ... Алуа 

A71. A/d Ago/d ... А,2/24 , (5) 
Ain /d Аҙһ/42 ttt Annid. 

ie. the clements of the original and the inverse matrix 

are related as aij = Ajd. 

Example 1. l'ind the inverse matrix 4-1 of the matrix 
233° 
123 
245 





› (1) We calculate the determinant of the matrix А: 








233 
d= 12 3|—2.2.54-3.3:24-1-4.3—2-2-3—1:3:.5 —4.3.2.—5 —1. 
245 
Since d 0, tho inverse matrix A^ exists. 
(2) We find the cofactors of the clements of the matrix А: 
, 33 . 
А45 —-—42, Аз = — 45|^ —3, 4n-|7 3І-> 
3 23 . 
te-as ЕП Au-|? 5 == 4, bM 3|=-3 
3 23 
Луз = 2 PED An=—|> 4 |-—> Аза = 12 = 1, 








(3) We compose an adjoint matrix 


Au 4544] [-2-3 3 
Ai An Аш | = 1 4-3}. 
Ais As Аза n —2 1 
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(4) We calculate the inverse matrix 


.[2 3-3 
Аз-44|-1-4 31. 


0 2-41 


2331 2 3-3 оо 
123 —1 —4 3|[-|010]|.A 
245]| 0 2 —1 aod 


Example 2. Inverse the matrix 


Verification: (147! = 





T 42 4 27 
31 1 --3 
A= —2 3 —1 1 
-—12 0 1 
A (1) We calculate 
12 4 2 
l 31 1 --3 
“|. әз -1 4]? 
—12 u 1 


for which purpose we expand the determinant aecording to the 
elements of the first row. We have 


























1 1—3 
Au—-|3 --1. d|—--14-2—0 -3— —s8. 
2 0 | 
з 1—83 
Aig-|—2—1 1|——(-—3-—1.43.EF3)— -1. 
—1 0 14 
31 —3 
An=| —2 3  1[|--0— 1--122—9 | 2—6 -7. 
—12 1 
31 4 
Ау —| —2 3 —1|= —(1--1-| 346) = — 6. 
—12 0 
Consequently, 


d — 1.(—8) -- 2-(--1) -+ 4:7 + 2-(—6) -= 6, 
i.e. the inverse matrix exists. 
(2) We calculate the other cofactors of the elements of the 
matrix 4: 
2 42 
Ай:--|3--11|--<(-2 |-8+4—12)=2; 
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1 4 2 
As -:| —2 —11|— —1--4—2 |-8—1; 
--1 01 
122 
Aggy - —| —2 3 1|-- —(83—2—8-+6-4-4—2)— — 
—121 
12 4 
Aq —| —2 3 —1|—<2—16-| 124-2=0; 
—12 0 
24 2 
м7-1|11--3|-2 .24--4—4— -– 31; 
20 1 
14 2 
Aga 77 31 —3 --(11|-42 | 2--12) - — 
-40 4 
12 2 
Аза 31 —3]--1 |-684-124+246—6—21; 
—42 1 
124! 
Аза 311(:---(-24-24--4--2)----24; 
—120 
2 4 2 
Ay cli 4 --3] --— (2 -30--2--ü-—6—4) «52; 
3--1 1 
1 4 2 
Аһ 3 4 —3|—1 E-24 —6--4—12— 3— 8; 
—2 —1 1 
12 2 
Auc —| 31-43|--(1--124-18--4--9--6)-- — 38; 
—23 1 
12 4 
Aa 31 4|— —1- 4] 36 --8—3-F6 -42. 
—23 —1 
(3) We compose an adjoint matrix 
“Ал А1 Ан 41| Г-8 2 --30 52 
A- Aiz Аз Ау Aga |. —1 t —3 8 
Ais Avy Aggy Ags | 7—1 21 —38 


А, Ang Ase Ags —6 и —24 42 
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(4) We divide all of the elements of the adjoint matrix by 
d = 6 and obtain an inverse matrix 4-1: 
— 8/6 2/6 —30/6 52/6 
—1/6 1/6 —3/6 8/6 


-1— 
4 7/6 —1/6 21/6 — 38/6 
—6/6 0 —24/6 42/6 
Verification: 
12 4 21[-8/6 2/6 —34y6 52/6 
agra) 31 14-3||-М6 4/6 —3/6 — 8/6 
—23 1 1 7/6 —1/0 21/6 — 38/6 
.—12 0 11Ll—6/6 о --24/6 42/6 
[7-—8—2-L28—12 2--2-4--0 
ү" 6 
--24--44-7-48 64-1—1--0 
d 8 6 
TF 16—3—7—6 —4-4-34-1--0 
^6 6 
8-2--0-6 —24240+40 
6 6 


—30—64-84—48 52416—152-|-84 ~ 
6 6 
—W—3421472 156+8—38— 126 


6 6 
60 —9—21— 24 — 104 4- 24 + 38 -|- 42 
6 6 
30 —6--0— 24 — 82 4- 16 4- 0-1- 42 
6 ó 2 
1000 
0100 
= | ооло [= А 
.0 0 0 4 


If the order of the matrix A is high, then this method 
of inversion of a matrix is very laborious. There are other 
methods of inversion of a matrix which we shall consider 
later on. 

It is very significant to find the inverse matrix A^! 
for solving systems of linear equations. 
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2.5. Solving Matrix Equations 


We shall consider three kinds of matrix equations 


AX — B, (4) 
XA - B, (2) 
AXB—C, (3) 


where 


is a square matrix of the same dimension whose elementis 
are unknown. 

Let us solve cach of the equations (1)-(3). 

To solve equation (1), we premultiply two its sides by 
A (on the assumption that the inverse matiis A^! 
exists): 


А AX = AB. 
But the product А-А = 1 and, consequently, ІХ = 
AIB, whence 
X = AB. (4) 


Example 1. Solve the matrix equation 
25 — 3 
ЕШ КЕН! 
— oe a 
A B 


25! 


— 0, 
19 23 + 


A (1) det A—|_ 
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We seek А-1. Since 4 = 9, А, = —5, Ay, = 1, Аз —2, 
10llows that 
9 —5 11[9 —51 
-- e A-À1— — 
A Е » |. whence A 23 |; 21: 


(3) From formula (4) we find that 


479 —51[—2. 31 4 [—2322 
— A-1H — —_ — — 
X= ANB= 55 [| all 1 _1]=эз [ 0 s| a 


In practical caleulations we often encounter equations 
of form (1), where x and b are vector columns of Lhe same 
dimension as the matrix А. 


Example 2. Solve the matrix equation 


4 42] [л] [1 
2 —12 т; |=| 11|. 
4 14 1 1-2 

—— — MÀ 








A x b 
1 12 
А (1) det A=|2 —12|—--4 FR-FA-F8 -2-8--і е 8. 
A 14 
(2) We seek А-1, We have Ay, = 0, А, 2, 43480005 
Aug = 0, Ag, 7 —4, Ag, = 2,414 6,494 = 3, Ag 9, 6, 
` -б —2 4 --1 —43 2/37 
А- 0—4 2], Я- o —2/3. 1/3]. 
6 3-3 1 1/2 -- 1/2. 


(3) From (ormula (4) we obtain 


—1 —1/3 2/3 —1 1 
=a] ) 2/8 | ЕЕ! 2) 
1 1/2 —1/2 —2 —2 


To solve equation (2), we postmultiply ils two sides 
by A`! (on the assumption that the inverse matrix A^! 
exists): 

XAA = BA”. 
This means that ХІ = BA, whence il follows thal 
X = BA, (5) 
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Example 3. Solve the matrix equation 


1 1—1 6 2-4 
X|2 —1 11:16 1 1|. 
1 0 1 8—1 4 


———— — 
A B 


A We find that 





1 1—1 
44А-|2-4 1|— —3, = —4, Ag —1, An=0, 
1 0 4 


Ai:= —1, А2, Аҙ) - —3, A15 71, A= 1, A= — 3, 


~ [4—1 0 ~ 14/3 1/3 0 
A ЕЕ 2 -3| , е-| 1/3 —2/3 |. 
1 1 —3 —1/3 — 1/3 1 


From formula (о) we obtain 


6 2—1]1[ 1/3 1/3 0 311 
X-BA3|6 1 1 1/3 —2/3 11—12 1 2]. 
8-1 4 --1/3 —1/31 128. 


To solve equation (3), we premultiply both its sides by 
A^! and postmultiply them by В-" (on the assumption 
that the indicated inverse matrices exist). Then we оВ- 
tain 


А-АХВВ-“ = ACB, or IXI = АСВ 
whence if follows that 
X = A'CB", (6) 
Example 4. Solvo the matrix equation 


1-32 1^ 8 —4 —4 
|: -4 | X |: 1 efi 5 "| . 
2 —53 123 17 —3 —4 

— / —— ———— 


——M 


A B с 
A We seck 


—12 —1 8 - a 4/A —AfA 
А--| —9 —1 6], B= 10-204 
-7 -1 5 --3/4 5/4 -1/4 


5-0104 
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(we recommend the reader to carry out the calculations indepen- 
dently). Next we have 


—12 —18 8—4 —4 22 19 30 
won| —9 — 1 | E 5 шн 13 4 
—7 — 1 5 17—3 — 1. 41 813 
Now we find from formula (6) that 
22 19 30 1/4 1/4 —1/4 2586 
LUE 13 n| | 1 —2 1 ІН: 2 s|. А 
14 813] | —3/4 5/4 —1/4 132 


2.6. Triangular Matrices. Expansion of a Matrix in 
a Produet of Two Triangular Matrices 


A square matrix is said to be triangular if the elements 
which are higher or lower than the principal diagonal are 
zero. If the elements which are higher than the principal 
diagonal are zero, then the matrix is a lower triangular, 
or subdiagonal, matrix. Such is, for example, the matrix 


ti, 0 ... 0 
T,= tyr із 2. 0 


. tni tna eee tnn 
Now if the elements which are lower than the principal 


diagonal are zero, then the matrix is an upper triangular, 
or swperdiagonal, matrix. Such is, for example, the matrix 


Гір Tig -.. Tin 

Т __ 0 Toa .-. Fon 
|) ....... 
0 0 Tnn 


The determinant of a triangular matrix is equal to the 
product of its diagonal elements. If T = [t,j] is a trian- 
gular matrix, then 


det T = 11,5... tnn 


The inverse of a nonsingular triangular matrix is also 
a triangular matrix of the same dimension and structure. 
If {То square matrix 
411 біз >>. Gin 
А аз база ... Gan 
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has nonzero diagonal minors (this is the name for the mi- 
nors of the determinant of the matrix which have the 
diagonal elements of the matrix on their principal dia- 
gonals), i.e. 
а 0 411 4із 
н * [азу аз 


then it can be expanded іп the product of two triangular 
matrices (the upper and the lower). This expansion is 
unique if nonzero values are preassigned to the diagonal 
elements of one of the triangular matrices (say, they are 
set equal to unity). 

Assume that 





+0, ..., det А-<0, 





А = СВ, 


where С is a lower triangular matrix aud В is an upper 
triangular matrix with diagonal elements equal to unity. 

Using a .vurth-order matrix as an example, we shall 
obtain formulas which express the relationship between 
the elements of the matrices A, B and C: 


411 053 Gis 214 спо 0 0 1 bia bis bi, 
азу аза Gas 44) (0i cn 0 0 01 585, 
азу (ға ба Gp | | csi Саз caa 0 00 1 5, 
441 243 Gas 44 Car Саз Саз Сла 00 01 


We multiply and then equate the resulting elements of 
the matrix CB to the respective elements of the «atrix 


Ср = 611» (1) 
Cor = 491, (2) 
Сз = 431. (3) 
Са = ад, (4) 
Суубуз == йуз, (5) 
Codie + Саз = Aog, (6) 
Cgi0ig + C32 = 435, (7) 
Cabia + Саз = Saar (8) 
суубуз = 015 (9) 
Сәбіз + Сәзҙбаз = 055, (40) 
Сзі0із + Casbas + Сзз = 233, (11) 


5* 
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Cabia + Сазбаа + Саз = las (12) 
саба == ау, (18) 
субу + Caba = 034, (14) 
Csiba + 033054 + С©зз?за = азд, (15) 
Cabia + собол 1: Саз за -F Саа == 444. (16) 


From equations (1)-(16) we find the elements бу, 
and cj (i = 1,2, 3, 4, j = 1, 2, 3, 4) of the triangular 
matrices В and C in the following order: 

(I) the first column of the matrix C [formulas (1)- 


(4)]: 
tn = au, i= 1, 2, 8, 4. 
(II) the first row of the matrix В [formulas (5), (9), 
(13)]: 
bij = аус, ) = 2, 3, 4. 
(ІП) the second column of the matrix С [formulas (6), 


(7), (8): 


Cig = Aig — Cdyn, i= 2, 3, 4. 
(IV) the second row of the matrix B [formulas (10), 
(1491: 
bey = (аҙ) — Caibi) зз, | = 3,4. 
(V) the third column of the matrix С [formulas (11), 
(12): И 
Суз = 043 — C045 — Сабаз і = д, 4. 
(VI) the third row of the matrix В [formula (15): 
bg, = (аза — Сб — Сазба4)/Сҙз- 
(VII) the fourth column of the matrix C [formula 
(16): 
Сад = 044 — Carbia — Саба — Саз0за- 
Scheme of Successive Determination of the Elements 
bij and Сї) 


Gij Gia @1з 414 са0 00 1 bsa big 614 
a31 4 Gog Gaa | | Со Соз 0 0 0 1 ba by 
gj Gg, Agg 434 езі Cag Саз 0 00 1 bg 


ауу 444 44; адд Car Сіз Саз Сад 00 0 1 
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сүү == 048 | bio = а/с, big = aae, Oy, = aule 





бізін | бы Pas i - IV 
би аи | бы °з fm vy 
Саз 44 | с | Сіз | | С 

І II V VIT 


The roman figures at the arrows show the sequence in 
which the elements c,; and b;; must be found. In this 
expansion we first find the columns and then the rows. 
То simplify the calculations, it is inore convenient to 
expand the matrix A in the product of two triangular 
matrices C and B using ‘Table 2.1 given below. 






































Table 2.1 
411 | 412 | "113 | "11 
51 | 023 | 023 | 54 
азі | ü32 | аза | 1з 
441 | 043 | ays | 414 
sm | 1 | bis аен | bis 7 3/6 уа == 4,7011 
C21 -7 031 | C22 | 1 | bay | bo, 
C31 = 031 | Сэ | Сӛз | 1 | bay 
— Т. 
€41— 041 | C42 | C43 | €14 1 


This lable is composed as lollow- 
1. On the basis of the formulas indicated above, we 
write the elements of the first column of the matrix A 
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in the first column of the matrix C and the elements of 
the first row of the matrix A, divided by c,,, in the first 
row of the matrix В. 

2. 'The elements which are under the stepped line can 
be found as follows: we take the requisite element of the 
matrix А and subtract from it the product of the elements 
which are to the left in the same row and higher in the 
same column as the required element, and here we multi- 
ply the first element of the row by the first element of 
the column, the second element of the row by the second 
element of the column and so on. 

For example, сзз = аҙ) — c3,b14 — Сзәбаз 

3. When we calculate the elements which are above the 
stepped line, we do the same as we did in item 2 but di- 
vide the result by the diagonal element с;; (i = 2, 3) 
which is in the same row as the required element. 

For example 5, = tie бада Coat ay 

83 

By analogy we can expand a square matrix of any order 
n in the product of two triangular matrices. Somewhat 
higher we have indicated the rule of transformation of a 
matrix into the product of two triangular matrices for 
the case b, = 1. Now if cj, = 1, then we must first cal- 
culate the elements of the rows of the matrix B using the 
formula 

1-1 


bs: а- 2i сө бы (Lj), (17) 


and then the elements of the columns of the matrix C 
using the formula 


1-1 
а)- У) сініп) 


ey=—— (>). (18) 


We represented the matrix А as the product CB of two 
triangular matrices, where C is the lower and B is the 
upper triangular matrix. This order of the factors is not 
obligatory, however, i.e. we can represent the matrix 
A as the product BC and obtain similar formulas for 
the elements of the triangular matrices B and C. 
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Example. Expand the matrix 











123 4 
—124 —3 
A=) 245—2 
432 1. 
in the product CB, where 
Сі 0 0 0 74 bis Біз 5% 
Cu с Cog O 0 _ 01 bab, 
| ев, саз es 0|! |00 1 ba 
Car Caz Сал Cas 00 0 4 
А Тһе solution is given in Table 2.2. 
Table 2.2 
1 | 4 | 3 | 4 
—1 | 2 | 4 | -3 
44; 
2 E 4 | 5 | -2 
4 а 3 | 2 | 1 
Е 3 un 4 | | 
т 
4-(-1,3 7 |-3-(-1)4 1 
ecu сема) $2599. 7 ын i 4 Ey 
1 
~2-4—(e 5 
ПЕЧЕ 4-2.2-0 |5_92.3— ЕЕЕ йо bij 
1-44-(-5) 
7 1 5 
2-43-(-9)-4 |x;—(—1)] 4 
5 5 
a | 3-42- —5 -—4 | к= 
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Verification: 
і 90 0 0 12 3 4 
—1 4 0 0 01 7/4 1/4 
cB=| 5 о _{ of Joo 4 40 
4-5 —5/4 —5/4 00 0 4 
23 4 


2.7. Inversion of a Matrix by Expanding It in 
a Product of Two Triangular Matrices 


It follows from the definition of the inverse matrix 
that if 


А = CB, (1) 


where all the matrices are nonsineular, we can find the 
inverse matrix using the formula 


A7 = BIC. (2) 


П To prove the validity of formula (2), we perform 
the following transformations. 

We premultiply both sides of relation (1) by the matrix 
C^ . 


СА = ССВ, or СТА = В. (3) 

We premultiply both sides of relation (3) by the matrix 
B; 

В-ІС-ТА = BOR, or (BOC) 4 = 4. (4) 


We postmultiply both sides of relation (4) by the matrix 
-1. 


(B1C7) АА-! = A1, ог Ai = В-!С-і. B 


In formula (2) the inverse matrix A^! is expressed as 
the pro-'uct of the inverse matrices B^! and C^, How- 
ever, if the matrices В and С are triangular, then, to calcu- 
late the matrix А -1, it is not necessary to invert the ma- 
trices B and C. 
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Let us derive formulas for calculating the elements of 
the inverse matrix A~! using the example of a fourth- 
order matrix. We designate the eleinents of the matrix 
A^! as аҙ) and the elements of the inverse matrices B~! 
and C^! as f; and yj; respectively. The matrices В and 
C are of the same kind as those given in 2.6. We postmul- 
tiply relation (2) by the matrix C and premultiply it by 
the matrix B: 


AC = В-ІС-ІС, or AIC = B^, (5) 
BA = BBC, or BA? = CV, (6) 
Matrices C! and 777! are triangular matrices of the same 


kind as the matrices C and В. We write relations (5) 
and (6) as follows: 


Qir біз Сіз баң сай 0 0 1 Bis Bis В.а 

Aat Aga Hin Pt сы бөз 0 0 _ [0141 Bes Bos 7 

Aj, Aaq Q33 034 Сәд Cag £33 0 роо 4 P4 J? (7) 
О.а Ban O43 0044 Cyr Сіз Cag Caa n0 0 1 

1 biz Bis Pig бал Ayo O43 Ary 7408 0 0 

04 lb Од Zoo Aag Qaa Күн Үл 0 0 (8) 
00 414 bj Q3, Ayo Ayy бл Yat Yaz Va 0 ‘ 

00 0 1 Qai iz Aaa 41; Үл Yiz Yia Yaa 


We shall multiply only the rows and columns the 
elements of whose products in the matrices 273 aw? C7 
are equal to zeros and unities respectively. 

We first consider the product AC = Bo: 


Bar = оси А 09268 15 033€ СР дас = 1, (9) 
Bay == «сүү -|- әәә F Aala "Г O24 — 0, (10) 
Bar = Әср -| Azzo F Оба”: Aala = 0, (11) 
Bay = алс + Qala 1 бузба F ааба = 0, (12) 
Boo = 91:0 -F азабзз + ©®Сзә -l Озабаа = 1, (13) 
Ba; = о3,:0 -1- Zalas l- Zalar F Aala = 0, (14) 
Ваз = 64-0 4- 04222 A- 0430! F 044642 = 0, (15) 
Взз = 9-0 H оз 0 -1- Aggy H aC = 1, (15) 
Ваз = а4,-0 +4- ол 0 -1- 645003 + аааз = 0, (17) 


04-0 -} Q43*0 + %'0 1-9 44€44 == 1. (18) 


=? 
L3 
- 

I 
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And now we consider the product BA-! = 
їз = 1:01) + 51,954 + bradas + 8,404; = 0, 
Vis = 1-043 + 54,04 + braaa + бода = 0, 
Үш = 1:04, + біз Azat ҙа + 64044 = 0, 
Yas = 0:94 + 1-0) + з®з5 + 0,4044 = 0, 
Үл = О-ац, 4 1-а, 1 5%ы + 6,4044 = 0, 
Yar = 0-04-00, + 1-03 + Osata = 0. 


C 
(19) 
(20) 
(21) 
(22) 
(23) 
(24) 


We һауе to lind 16 unknown elemenls о; from rela- 


tions (9)-(24). We have 


I. а -– 1e, 
®з = (1/633) ( — 940,3) 
ag (1/e55) (— 43635 — 044042) 
044 = (1/044) (— оС — 043634 — 04041) 
П. аз, = — баьо 
® „== — baga, — Dorr 
„== — biag, — 13003, — 5,05, 
ПТ. оза (1/655) (1 — 316,3) 
«з»; == (1/655) ( — 33655 — (за) 
G3, == (1/044) ( — 3565, — 033631 — €31041) 
IV. аз — - зд — 505 
Оиз = —5,,0434 — 0,4933 — БО 
У. „= (1/e5,) (1 — 653055 — 946%) 
hey == (1/644) (— 055621 — 9363; — 03411) 
VI. оц, = —5,,2,, — 5,4095, — 5,04; 
УП. з = (1/044) (1 — 0,505, — 943631 — 944041) 


[from (18)] 
[from (17)] 
[from (15)] 
[from (12)] 


[from (24)] 
[from (23)] 
[from (21)] 
[from (16)] 
[from (14)] 
[from (11)] 
[from (22)] 
[from (20)] 
[from (13)] 
[from (10)] 
[from (19)] 

) 


[from (9)] 


Using the relations obtained at stages I-VII, we arrive 


at the following scheme. 
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Scheme of Successive Calculations of the Elements 
of an Inverse Matrix 


VI IV II 
vita! б, | Өз Tay { 
Boy Qos бәз а, 
Vu 

O3 Оз 93 O3, 
III — 

Q4 Ain 4а Qs 
I] 4——————— 


Using this scheme, we can calculate the inverse matrix 
A^! of the matrix A of any order if it is expanded in the 
product CB of two triangular matrices, where C and P are 
triangular matrices of the same kind as those presented 
above. 

This expansion results in the following formulas for 
the elements of the matrix A7: 


n 
y= — 2) buo (t< j). 
h- 41 


n 





1 ; . 
€ eH (- > БЕ (25) 
h-i41 
п 
У GihCh] 
Qj = cH (i> j). 


Example. Using the expansion of the matrix 


3—2 2 0 
2 4 1-2 
4A—|3 141 2 4 
4 2—1 —i 


in the product of two triangular matrices, find the inverse matrix 
А-1, 

A We compile Table 2.3 (see p. 76). E 

We calculate the elements of the inverse matrix in the 
consecutive order indicated above (see the scheme), using formu- 
las (25). 
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Table 2.3 
3 | -2 | 2 | 0 
2 1 | А | -2 
А 
3 | 4 | 2 | А 
| 1 | 2 | -4 | —1 
3 | 1 | -2/3 | 2/3 | а 
„(2 
А i2 (73) (ЙЕ-2 ӘЗ — i| -2-200 6 
27 73827 "y3 7271 
“3 
2 
2\/ 03.24] |1—3-0-—-1-(—6ут) 
C 24-3. [2 1—3:0--1:(—6/7) | p 
a 1-1-3:(-5) з | 171 
ef ( JEE 243 
= х(—7)=°1 
-г- 
21-12-18 -1-10-% 
2) 8 3 3 6 
1 р) ‚ау 09 х(-тә) | 
х(—) —7 8 
-(-)хіз-ів 
2 cus dee БЕ 
1/3 48 СЕИ n 8/18 
—12/18 5/18 1/2 118 





— 1/3 -5/18 


-12718 11/18 mnd s | 1/2 | —13/18 
Lape o 
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I. ода = 1/644 = 1/18, 





a = ©4443 —- __ (1/48) -(—9/7) | AL 
43 C33 1/7 2’ 
„= — Masc b 04асаа — (1/2).1--(1718)(8/)) __5 
43 Con 77 7/3 777748” 
a, = -Zaza 17 азса + salar 
ат 5a" 0 
_ (CC5/8)2-E(/2-34 0/18-1 —— 1 
3 3° 
П. gg = — 53494477 — 13/18, 
(54 = — (b53034 F 24044) 
1 13 6 1 1 
--((-т):(-а)"(-т)әж|Е-зғ. 
Qia = —(b15854 1-013834 + 014044) 


BA) HC ded 


ЕЕ КЕ 








2 , 
а, = o Ssss T Aata _ _ 4/2)1--(—13/18) -(8/3) 11 
uu Cog Е 7/8 7748” 
Qa = — 0135621 + €33€31 + 034641 
31 cu 
(11/18) - 24/3). .3-|-(-13/18). 4. | 42 


18° 
IV. аа-- te Put 


1) CES 


Qia = — (b15055-1- 530.33 + 5,4043) 
2 1 2 1 1^ 
.--- ---.--- .— |=0 
~ L( 7) a rt z | ^ 


1 
V. а= сы [1 — (8.55635 --634642)1 


iem 1 к(—+ ж): (8/2) | 5 
” 7/3 — 18 ' 
aster Раби estan 


у= — 


__ (5/18). э+@®. 3+(—41/18)-4 _ 12 
18° 
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VI. dia = — (513845 + b139:33 F 140143) 
--[(-*) wu gt (i ж) |=- 


1 
VH. аџ = eu [1 — (9; gear + 913631 + 914041)] 


4 4 8 4 
=> [i-(—3) 34084-4541 | => 
r 6—4u 8 


11—12 59 —4 
. -1 — — 
Answer: A i8l 42 4 9 —13]^ A 


—6 —5 9 1 


2.8. Step Matrices and Operations Involving Them 


When calculating higher-order matrices, it is expe- 
dient to partition them into blocks by means o£ horizon- 
tal and vertical lines. Thus we divide every matrix into 
matrices of lower orders which are much simpler to cal- 


culate. 
A matrix partitioned into blocks is called a step mat- 


гіх or а hypermatriz. 
For example, (1) matrix A is partitioned into four 
blocks 
аз] 413 | 413 414 
А- 031 033 | баз 0% = [52 An A = | 
азу @зз | ss 4% Аз | án J’ 
441 G43 |443 444 


which are square matrices 
_| 21 бїз — | біз 414 
Ay=[ 4ҙ1 223 ) Auc [5 424 | ' 
БЕТЕН 
"Uo Lag ays J”? 443 444 
(2) the nth-order matrix C із partitioned into four 
blocks 
C= [ Са-і | Чп-1 |: 
Vn-1 | Спп 
where C, , is a square matrix of order n — 1, u, , isa 


vector column of order n — 1, уһ is a vector row of 
order п — 1, and cy, is a scalar. 
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Such a partitioning into blocks is known as bordering 
of a matrix and a matrix is said to be bordered. 

We can add and multiply step matrices manipulating 
the blocks of a step matrix as the elements of an ordinary 
matrix. 

Assume that 


Nr 











qt Jana В. [| 3] 


are step matrices of the same order and partitioning. Then 


„.[ -Аи+ Ви | А-В 
А-в-| Argi jeu |: 


AB - [ А11В11-1- А14 Вә 











Ау\Вуз- А»Воз | 


Аз1В1-- АзэВау | 4182 + АВ 

Example 4 Partition the matrices 
57 —3 —4 1234 
76 —4 —5 2345 
А-|64-3-2|4148-|1357 
85 —6 —1 246 8 


into square blocks and calculate A -- В and AB. 
A (1) We partition the matrices A and В into square blocks as 
follows: 











75 7[—3 —4 
A= An аи |. 76|-4 -5 
-[2 4417 |641-3 --2]° 
85)|-6 —1 
12134 
[Ba] 22] |23143 
-[z: |= 13/57 
2416 8 
(2) We find that 
69|00 
[Ant Ви uoa |= 99/00 
Ав тестісі ЕРЕ 
109107 


(3) We have 


АВ= [анн + AuBgi апи Аша | . 


AaBii + AaaBar | 4218121 AnBa 
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We find in succession that 
[57 121 [1931 
AuBu =[ в] [5 з |= [а 32 | ' 
—3 —4 13 —11 —25 
Ава =| 7; 74 [5 4l [24 E , 
86 
АВ А,В = [5 a] , 
64 12 14 24 
AnBi—-|g s] [2 3 (в | 
—3 —2 13 —7 —17 
4АВа= | g 741 24] [в —22]|"' 
77 
Agi By, + 454841 = 40 И , 
57 34 43 55 
AuBi [7 6) [5 5] lis M ' 
—3 —4 57 —39 —53 
ааа 5] [68] L25 в]. 
4 2 
AuBis- AnBa-| _ 5 0] ; 
6 4 34 34 44 
AuBis- |$ 5| [5 5 “Ги 571" 
—3 —2 57 --27 —37 
лава | 7% 71 [6 И ШЕ | ' 


77 
Ааваа | g 7] . 


Thus 
86 4 2 
50] —5 — 40 
АВ=| 77| 7 3|-4 
10 9 8 7 
Assume that 
a= [22 Ant | and B= [| 2r] Yn-11 
Vn-1 ann Xn-1 | ban J’ 








are burdered step matrices of order п and of the same par 
titioning. Then 


A+B= [ An-1+ Ba-1 


Vn-1 T- Xn-1 





Un-1 + Yn-1 ] 
ann tönn J’ 
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where Ana -1- 24,4 is a square matrix of order n — 1, 
u,-1 + yn. із a vector column of order n — 1, 
Vna F Xn- is a vector row of order n — 1, 
аһһ + Onn are scalars; 


АВ-- [ An-1Bn-1- Чһ-18а-1 | ÁAn-iYn-i | Un-ibnn | 
Vn-1Bn-1-d- 9nnXn-1 Vn-1Yn-1-l- @nnOnn 


where 44,7, , + u, 4x4, is a square matrix of order 
n —1, 


А „Луна + Чалла is a vector column of order n — 1, 
Ура а-ы @nnXn-1 is а vector row of order п — 1, 


уллула Е @пп?пһ аге scalars. 
Example 2. Partition the matrices 


58--4 3 25 
69-5|ам В-|4-13 
41-3 9 65 


into blocl. b, «eans of bordering and calculate А -- B and АВ. 
A (1) We partition the matrices А and B by ineans of bordering: 


Aw: 























58| - -4 _ 3 2| 5 
А=| 69| —5 {= 2]. В-.|4 —13|- Е z]. 
47|—3] ^V» a 5| жа бәз 





(2) We find that 


_ . 8 10 
лв=|# v а | jo 8 
Va-F X4 493-533 13 13 





1 
2 
(3) We have 
AB= M -- ugXs days t uas] . 


уаВ,--аҙух, VoY2-t 5333 


We find in succession that 
5,8 3 21 [472 
лав [5 a] [| a] (м з] , 


—.4 — 30 —24 
[6] (9 6] [24 ЕН ' 


11 —22 
А,В, ак | 9 —21 |i ’ 


^s [59] [3 ]- Le]: 


— — 2) 29 
uba [ 5] 5-|7% , Азу d sb | 39 | , 


6--0104 
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val, = [4 7) [ = 1], аззха = (— 3). [9 6] = [— 27 — 18], 
VaBa + asx = [13 — 17], 
5 
Yaya = [4 7] [ 3 J=, ауз зз = (—3)-5 — — 15, 
Vaya + 635033 = 26. 


и —22| 29 
9 —27| 32| . A 
13 —17| 26 


Thus 





2.9. Inversion of a Matrix by Partitioning It 
into Blocks 


To find an inverse matrix, we can use the method 
anal . [ánna] ; 
of partilioning into | blocks. Let A -| Aui 42] is a 
nonsingular step matrix of order п in which A,, and А, 
are square blocks of orders p and q (where p +q = n). 
We have to find the inverse matrix A^! = [222]. 
. . . Ва Ва 
іп which B, and В,, are square matrices of orders p 
and q too. 

According to the definition of the inverse matrix, 
АА"! = In. In this case, the identity matrix will also 
be partitióned into blocks in the same way, i.e. In = 

Ip 0 

0 Iq 
orders p and q respectively. Then 


434 = | ы 22] Аһ 48] = Ір 0 | 
Ba; Ву Ag; Ass 0 Iq J 


whence, after multiplication, we get four matrix equa- 
tions 


|, where J, and J, are, identity matrices of 


By Ay + By Agi = Ip 

By Ars T B4, =0, 

By Ay t Boy 4, =0, 
В.А + В,,А,, = Iq. 
To find the blocks of the matrix А-!, we have to solve 
the system of matrix equations (1). To do this, we use 


(1) 
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the method of elimination of the unknowns. We postmul- 
tiply the first equation of system (1) by Aj'A,, and sub- 
tract the second equation of the system from the result of 
the multiplication. We obtain 


Bis (Ал4 Are — Ay.) = 41444. 
From this we find that 
Вуз = — АцАз (Ал — ААА уз), 
Ba = Аџ — Pun. 
Similarly, we find from tlie third and fourth equations 
of the system that 
В, — (Age — Ag, Ati А4), 
By —- — Bog Ag, Aii. 
This is possible under the condition that the requisite 
operations lave sense. We introduce the following desig- 
nations: 
X = А4, Y = 1А, 
O = А, —AnX = Az — YA), 
Then the formulas for the blocks of the inverse matrix 
A^! can be written in the following form: 
By = Ат + ХӨЧҮ, By, = — XO, 
Ba = —071Y, В,, = Ө-!. (2) 
Formulas (2) are valid provided that Aj} апа Өзі 


exist. It is convenient to make the following scher for 
calculations: 









| Án | Аза 
X = Alis | Ai | Aia 
8-1 Y= 421411 | Ө = Аза -- Y Ais 








The inverse matrix has the form 


д. [ Ан xev CS] 
[28$ Өзі |: 
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Example 1. By means of partitioning into blocks, invert the 
matrix 


40 42 
—1 2 3 1 
A=| —471|7214 
0 2 12. 


A We designate 


10 12 —2 1 
Au-[ _{ 19 1 An=| 3 | , A, = һ 21. А, -| 1 2| 


and make the necessary calculations: 


2í 
det 4,,—2, Ajo d: 


1 20 
x-Atte-z [1i] [53]. [43]. 
1740 2 07 40 
Ү= An A= > [ 2| [| 1 [1+ 


РЕТ [72 i] ЕНІ 


4 —73 
—3 el] 


We write the initial data and the results of the calculations in the 
form of the following table: 


222-245. ZONE 
det8— —15; Ө =| 











4 [243 1 1-71 ir- 40 
l -— 
хө-і---; [4 ME 15 E 3 s]- 30 [ —5 ша] ' 
-10 —407 (i 01 14 7—30 40 
—5 7011 44]730| —30 о] 


ХӨ-+ү = RS AT 
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1 1 —7 40 1 —3 —T 
чү — 
o'Y= 15 | 3 в] 14 Ее [75 ME 
1724) 1[—3 —7 1[—30 10 
-1 = .--- = — 
хөзу-- |33] | o 6 1= 36 | —30 —190]' 
To ensure the correctness of the result, we have used two techniques 
to calculate the product ХӨ-1Ү: ХӨ-ІУ = (X0-!) Y and X0-1Y — 


X (8-31Y). 
The final result is 


A3 -| Ай --ХӨзіу 26-7 


—0-Y 0-1 
1 0 10] 4 710 —410 
u sls 5] 37 5 10 
C] 4 3711 1 —T 
ls НЕЗ «| 
0 10 10 —10 
4|-45 5 5 10 
30 о 44 2 —14]°4 


12 —12 —6 12 


The method of successive bordering is a special case 
of the method of inversion of step matrices. 

Assume that we are given a nonsingular square mat- 
rix of order n 


011 412... Gin 

А- азу 492... Zen 
—— ?, 
an; Ün3 ... anni 


for which we have to find the inverse matrix A-!. 
We compose tle succession of malrices: 


A, [ау], 
tiy 
зз je 
aa 


ауу а 
А, =[ 11 414 ] 
“ 421 aag | 


tii 015 013 A 
2 
Аұ-: | а 422 an | = 
03] az 033 031 035 








011 Aig 0313 ауд 7 414 

А ауу daz аа dog | | 4; 054 
8 == I 

аз faz Qag 03, 034 





041 44; 443 Fas 0441 Gaz Gas | Gaa 
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A;' = B, | bay sa], 





ba Б 
Сіз 
ame = |, 
C31 Сза | Cag . 
4, 
ар | Эз dg 
A, = р, = dy 


d,i 443 dis du 


and so on. Each successive matrix is obtained from the 
preceding one by means of bordering. 

The inverse of the second matrix А5! = В, can be 
found in a direct way: 

a uu 43/1431 --414/14.1 
4; = B,=[ — 431/144] 411/14, J" 
where 


ац 4% 





[Ay] = 





= — 0450.4. 
а, йу» аа; — 412424 

Using the matrix А; and applying to A, the scheme 
for calculation presented above, we can get А;!, then 
using A;', we can similarly get Аф, ... , and finally get 
Ағ = А. 

Example 2. Using the method of successive bordering, invert 
the matrix 





'9—4 50 

2-3 411 

4—|3 5 —1 2 

3 —4 41. 

A We have 

—3 —4| 5 19 

2—3| 111 

4- 3-5 —1 |2 

3—1 4 1 


(4) Aie [ 74. det A,= —9-L8— —1, 


Ав, [2 73. 
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(2) The scheme for calculating 451— C, has the following form: 


[231233] | las 





We carry out the calculations 
oaa [481 [3 ЕЗІН -|Е1 
х= []-[$ 28] U 12 UST: 


У = [ал a») 45" 18 —5 [5 —5]-1-1 31, 


Ө=а»—Ү| ] = —1—[—41 ali ]=-1+2=1, 


—11 33 
—7 21 


831 14, хөзү - [114-1 a-[7 


Then we fill in the table: 








We obtain the elements of the inverse matrix Аҙ!-- С; alter 
making the following matrix additions and multiplications: 


€gy = Ө! — 14, [esi сәз] = —O7Y=[1 —3], 


[5]--xe* -[ 5 


С,= [2 гіл | == Az! + ХӨ-!Ү 


©21 Саз 


НИЕ i] 
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—8 29 —1t 
Ай -бу-|--5 18 —1|. 


1 —3 1. 


Thus 


(3) To calculate 4;!— D,— 4-1, we compile a table: 


[041242243] | 









A3! 


Then we carry out tbe calculations: 


—8 29 —11 0 7 
Х-|-5 18 =| | | , 
1 —3 1 2 —1 


—8 29 —11 
Y=[3 —14]| —5 18 - ees 57 — 22], 
1 —3 1 


0 
@=1—[—15 57 —22] | iere —12, Ө-І-- —1/12. 
2 


We fill in the table: 
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da= 4: (dadida = -у 1—15 57 — 22], 


da Cg 4 , 
4, 12 —4 


—8 29 11 7 
D,—451g-X0-31Y —-| —5 18 -|-&| а 57 —22| 
—4 


4—3 1] £ 


[= 348 —132] ‚Г 105 —309 454 
-2|-Ө 216 —84| |] 60 —228 J 


12| 42 _36 12] 12| —15 57 —2 


Thus 
9 — 54 22 T 
1 0 —12 4 4 
-1-- li. 
A “424 —3 24 —10 —1 А 


—15 97 —22 —1. 


Тіе method of bordering can only be used if all the 
intermediate matrices A4, Ay, ..., Anı are nonsingu- 
lar. 


2.10. The Absolute Value and the Norm of a Matrix 


The absolute value (modulus) of the matrix == [ajjl 
is a matrix |А |= [Í |a: |l, where all the elements 
| а; | are the moduli of the elements of the matrix A. 

Let A and 23 be matrices for which the operations 
A -+ and АВ have sense. Then 


(1%) 14 +В [< 1A 13-108], 
(2°) IAB | <|A|- [ В |, 
(3°) [01| = | о [- [4 |, where а is а scalar. 


The norm of the matrix A = [a;j] is a real number 
|| A ||, which satisfies the following conditions: 

(1°) | A i> 0 (with || A || = 0 if and only if A = 0), 

(2°) || aA || = [о | {| А ||, where а is а scalar 
(with || —A 1 = ПА Il), 

(3°) 14 +B YU<SWAN AUB, 
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(4°) I| ABI iL АП ВІ, 

(5°) 14 —B I> 1181 —1[A [| where A and Л 
are matrices for which the corresponding operations have 
sense. 

Let us consider the following three norms, which are 
easy to calculate, for the matrix A = [a,,] of an arbitra- 
ry dimension: 

IA 1; = max >} [а | is the marimum sum of the 


2 
moduit of the elements of the matriz by rows, 
IA 1, = тах У | aij | is the татітит sum of the mo- 


duli of the elements of the matriz by the columns, 
| A lls = =v) | а) |? is the square root of the sum of 


the squares of the moduli of all the elements of the matrix. 


Example 1. For the matrix 


2 —1 4 
А-|5 3 2 
6 —7 3 


calculate || A Ilh, || A ll, and || A Ils. 
A We find that 
Il А1 — max (2--1--4, 5434-2, 64-7--3) = тах (7, 10, 16) — 16, 
ПА l= max (24+ 54-6, 1--3--7, 4--2--3)-- max (13, 11, 9) = 13, 
Il Alls = V 233-13 7 42 1-53 4-83 3-22 3-63 - 7 3-33 V 153 — 12.2. А 
Ti 
For the vector x — Б these norms сап be calcu- 
zn 
lated by the following formulas: 


lx ||, = max|z,]is the coordinate of the vector 
mazimum in its absolute value, 

ж | = tz |+ lza l+.. + |е Lis the sum of 
the moduli of the coordinates of the vector, 

llxlis Y [a]? + ita P+... Е 2 isthe 
square root of the sum of the squares of the moduli of the coor- 
dinates of the vector. 

The norm ||х ||, is the absolute value of the vector. 
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1 
Example 2. For the vector x — 2 calculate || x ||;, || X lla 
—5 
and || x ||). 
A We have 


l| x |; — max (1, 2, 3, 5) —5, || x;||—12-24- 3--5— 11, 
IIx ll V 1223-3: -5* = Y/89— 6.2. A 


2.11. The Rank of a Matrix and the Methods of Its 
Calculation 


Consider a rectangular matrix 


аі] 6412... Ain 
A= йу Gaa ... Aan 


If we choose k arbitrary rows and k arbitrary columns іп 
this matrix, where k < min (m, n), then the elements, 
which are at the intersections of these rows and columns, 
form a square matrix of order k whose determinant is a 
kth-order minor of the matrix A. 

For instance, the intersection of the first and second 
rows with the first and second columns of the matrix 


A is occupied by a second-order matrix [ou 2] whose 
21 22 


determinant is a second-order minor of the matrix A. 
We designate it as M,: 
411 41; 


M,= 
йз 095 


'The rank of the matrix A is the maximum order of the 
nonzero minor of this matrix. It follows from the defini- 
tion of the rank that if the rank of a matrix is r, then there 
is at least one nonzero minor of order r in the matrix 
and all the minors of order r -|- 1 and of higher orders are 
zero. Note that the rank of a zero matrix is zero and that 
of a nonzero row matrix (or column matrix) is equal 10 
unity. 

For a rectangular matrix of dimension m X n the 
difference of the least of the numbers m and n and the 
rank of the matrix is known as the deficiency of the matrix. 
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For an n X n square matrix the deficiency is equal to 
n —r. If the deficiency is zero, then the rank of the mat- 
rix is the greatest of the possible ranks for that dimen- 
sion. 

Let us consider one of the methods of calculating the 
rank of a matrix based on the definition of the rank. 
In this case it is necessary to find the minor of the max- 
imum order different from zero. When using this me- 
thod *o calculate the rank of a matrix, we pass from mi- 
nors of lower orders (beginning with the minors of the 
first order, i.e. the elements of the matrix) to the minors 
of higher orders, carrying out the operations according 
to the following rule: assume that we have found the 
rth-order minor M,, different from zero; then we have 
only Lo calculate the minors of order r -+ 1 which border 
Ше minor М,. If all these minors are zero, then the rank 
of the matrix is r, but if at least one of them is nonzero, 
then the operation must involve that minor, and in that 
case the rank of the matrix is obviously higher than r. 
This method of calculation is known as the method of 
bordering. 

Example 1. Using the method of bordering, find the rank of 
the matrix 


2 410 
2 4 110 
>- A= ырын 
—1.—2 8 1 
EN 


A (1) We choose a first-order minor which is nonzero: M! = 
аз = 4 Æ 0 (the upper index is for the ordinal number in the 
calculation and the lower index is for the order of the minor). 

(2 We find the second-order bordering minor which is nonzero: 


41 
1-- 0 
Mi-|. 5 3] #0. 
(3) We consider all third-order minors which border the minor 


Mi, for which purpose we compose minors М! and M2 from the 
second, the third and the fourth row: 


2 41 4 10 
Mi-|—1 —23/=0, М4-|-2 3 1/=0 
0 07 072 














since in these minors the third row is equal to the sum of the first 
row and the doubled second row. 
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The bordering minors from the first, the second and the third 
row are also equal to zero since the first and the second rows are 
identical. [f all the third-order minors are zero, then all the higher- 
order minors beginning with 3 -|- 1 -- 4) are also zero. Conse- 
quently, the rank of the matrix is 2 and the deficiency 4—2 = 2. A 


Since the number of determinants of different orders, 
generated by the matrix, is usually large, the calcula- 
tion of the rank by the method of bordering is very la- 
borious. 

It is much simpler to calculate the rank by means of 
elementary transformations of the matriz. 

The elementary transformations are 

(1) permutation of two rows (columns), 

(2 multiplication of a row (column) by a number 
k (k Æ 0), 

(3) addition of a row, multiplied by a nonzero number 
К, lo ате (Рак row (column), 

(4) elımination of a row (column), consisting of zeros, 
from the matrix, 

(5) elimination of a row (column) which is a linear 
combination of other rows (columns) from a matrix. 

Elementary transformations do not change the rank 
of a matrix, i.e. transformations of this kind result in a 
new matrix which is nol equal to the original one but is 
equivalent to il (the ranks of these matrices are equal). 
The symbol — is used to denote the equivalence of ma- 
trices. 

Transformations of a matrix can ve carried ov: in the 
following order. 

1. Tf the element a in the upper left corner of the ma- 
trix is zero and (he matrix has nonzero elements, then by 
interchanging rows and columns we replace the zero ele- 
ment by one of the nonzero elements and, using elemerta- 
ry transformations, turn all the other elements of the first 
row and all the elementis of the first column into zeros. 
In what follows, the lirst column and the first row remain 
unchanged (we can only interchange them). If all the 
other elements of the transformed matrix are zero, the 
rank of the matrix is equal to unity, i.e. r — 1. 

2. If ag, = О in the transformed «atrix but there аге 
nonzero elements, we can put one of them at the inter- 
section of the second row and the second column and 
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apply elementary transformations to turn into zeros 
first all the other elements of the second row and then 
all the other elements of the second column and continue 
with the transformations in a similar way. 

As a result we can obtain a matrix whose elements are 
only unilies which are on the principal diagonal, the 
number of these elements being equal to Lhe rank of the 
matrix, and whose other elements are zeros. 


Example 2. Using elementary transformations, determine the 
rank oi the matrix 


123—1 
—132 0 
А-| 314-2 
—341 1 


A Let uscarry out in succession the following elementary trans- 
formations of the matrix. 

(a) First we add the first column to the fourth and then, multi- 
plying in succession by (—2) and (—3), add the results to the second 
and the third -column respectively. 

(b) We eliminate the second and the third column since they 
result from the fourth column after the multiplication by (—5). 

Then we have 


123 —1 1 0 0 0 7 4 0 
—132 0 —4 5 5—1 —4 -4 
А=| 314-2|0| з-5-5 419| 3 1 
—341 1 —3 40 10 —2 —3 —2 


]t is evident that the rank of the last matrix is 2. It cannot be 
higher than 2 since if r = 2, then the deficiency is zero (n — r = 0) 
and cannot be lower than 2 since the matrix has a minor M, + 0. 

The matrix obtained is equivalent to the matrix A and, con- 
sequently, r (4) — 2. 

We can arrive at the same result if we continue with the trans- 
formations of the matrix. 

(c) First we add the first row to the second and then, multi- 
plying it in succession by (—3) and 3, add the results to the third 
and the fourth row respectively." 

(d) First we add the third row to the second and then, multi- 
plying it by 2, add the result to the fourth row. 

(е) We eliminate the zero rows. 


We have 
4 о 1 0 10 
—4 —4 0 —1 00 10 
4A-| 3 4] Ojo 4| [01 e loal. 
—3 —2 0 о 00 
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The last matrix does not play the part of an identity matrix, 
it results from elementary transformations and is equivalent to 
the matrix А. The number of unities on the principal diagonal of 
the matrix obtained is 2. Consequently, r (4) — 2. A 


2.12. The Concept of a Linear (Vector) Space. 
The Linear Dependence of Vectors 


The linear (vector) space is the set U of elements x, 
y, 2, .... for which the operations of addition of the 
elements and the multiplication of them by a real num- 
ber can be performed within the set U and which satisfy 
the following axioms: 

(1) х--у-у--х, 

(2°) (x + y) -+z =x + (y + 2), 

(3°) there is an element 0 € U such that x + 0 = x, 

(4°) for every x there is an opposite clement —x € U 
such that х--(-х)-- 0, 

(5°) 1.х = х, 

(6°) a (Bx) = (ap) x, 

(7°) (а + B) x = ax + px, 

(8°) a (x + y) = ах 4- ay, where x, y, 26 U and a 
and B are real numbers. 

Note that 0. x = 0 аба (—1) x = —x. 


Example 1. The set of all n-dimensional vectors with the ordin- 
агу operations of addition of vectors and multiplication of a vector 
by areal number о, forms a linear space since these operations satisfy 
axioms 19-89, 

The sum of two vectors x = (z,, га, .. ., Tn) and y = (yy, 
Var п) із a vector 2 = x + y = (2) + у, 74+ Yar - 
Zn + ул\; the product of the vector x by the number a is a vector 
ах = (агу, ат„, ..., AZn) (see 2.1). The vector 0 = (0,0, ..., 0) 
is a null vector; the vector —x = (—z,, —z$4, ..., —z4) is op- 
posite to the vector x. All the axioms of the linear space are 
evidently satisfied. 

Example 2. The set of vectors of different dimensions is not 
8 linear space since the operation of addition is not defined for them. 

Example 3. It can be shown that square matrices of the same 
order form a linear space whereas square matrices of different 
orders do not form a linear space since the sum is not defined for 
them. 


The notion of linear dependence of vectors is of great 
importance in linear (vector) space. 
If х, x,, ..., x, are vectors from the space U, then 
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n 
the vector 2 = сух, + сұх, +... + сах, = Уу суху із 
ici 
a linear combination of the vectors хі. 
n 


If the vector z = У! сух, = 0 but among the numbers 
i-i 

Сіз Сәу.» +, Cn there is at least one number different from 

zero, then the vectors x, are said to he linearly dependent. 


The уесіогѕ хі, хз, ..., x, are linearly independent 
п 


if their linear combination 2 = > сұх; is equal to the 


wl 
zero vector if and only if all с; = 0 (i = 1,2, ..., n). 
There are nol more than two linearly independent vec- 
tors on the plane and nol more than three linearly in- 
dependent vectors in the three-dimensional space. 
Theorem. If the vectors xy, Ха, ...; x4, which belong 
to the linear space U, are linearly dependent, then at least 
one of them is a linear combination of the other ones. 








D) Since the vectors хі, Xz, ..., x, are linearly de- 
pendent, il follows that суху + cox, 4-... F саха = , 
and at least one of the numbers c, (і = 1, 2, ..., n) is 
nonzero. Let с, 5 0 (A<k<n). Then the vector x, is 
a linear combination of the vectors ху, X4, .. ., Xr- 
Харад +++) Xp: 

с. с 
" X, == — — X,-- —— X, — 
h Ch 1 ch ~ 
Ch-1 Chit Cn 
e — Хь — Хк — ...— — x,. B 
Ck k-i m hti cy n 


Example 4. Given a system of z n-dimensional unit vectors 
е = (1, 0, 0, з 0), 
e, = (0, 1, 0, ..., 0), 
e, = (0, 0, 0, ..., 1) 


find out whether the system is linearly dependent. 
A (1) We form a linear combination of these vectors and equate 


it to zero: 
се + суе + ... 4- ee, = 0. 
(2) We write this relation in coordinates: 
‘ eid ceal- Hen 00, 


€4:0-4- 03:1 4- ... сп :0=0, 


€3*04- c5: OH 2... 6e,-1=0, 
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Tlence e; == су = c4 = ... == e, == 0. This means that a sys- 
tem of n n-dimensional unit vectors is linearly independent. It 


is evident that any part of this system of vectors is linearly inde- 
pendent cither. 


Example 5. A ven vectors x, = (1, 2, 3) and x, = (3, 6, 7), 
find out whether theso vectors are linearly dependcnt. 


A (1) We form a linear combination of the vectors and equate 
it to zero: 


сілі + сук, = 0. (а) 


(2 The vector equality (+) is equivalent to the homogeneous 
system of thrce linoar equations with two unknowns 


1 1+ 303 — 0, 
| 2еу--6с„= 0, (++) 
Зс + 7e, — 0. 


(3) We divide both sides of the second equation of system (е) 


by 2: 
1*6014- 3e4 = 0, 
{ 1«c4 4- 3e4 —0, (жа) 
3с, + 7с, = 0. 


There are two identical equations in system (әж») опе of which 
we delete. 


(4) Solving now the system 


( 1:e, + 3с = 0, 
3с 7с =, 


we get c; = 0 and с, = 0. Thus tho given system of vectors is 
linearly independent. Д 


Example 6. Given vectors x, = (1, 3), х, = (0, 2), x, = (5,7), 
find out whether this system of vectors is liucarly depender . 
A (1) We form a linear combination of tho vectors and «quate 
it to zero: 
Сү + саха + CgXg = 0, (•) 


We write relation (ж) in coordinates: 


( 1.64 4- 0*6, 3-564 —0, (ее) 
3с, 4-2e, -- 7040. 


Wo have obtained a system of two linear equations with three 
unknowns. 

(2) We use the method of substitution to solve this system. We 
substitute the expression c, = --5сҙ, obtained from the first equa- 
tion, into the second equation: --15с; + 2c, + 7e, == 0. Hence 
Са = Ácg. We assign an arbitrary nonzero mumerical value to es, 
вау, cg = 1. Then c, = —5 and c, = 4. 

(3) We substitute these values into relation (e): 


--5кі + áx, + x, = 0, or x, = 5x, — áx, 
3—0104 
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i.e. the vector x4 is a linear combination of the vectors x, and x,, 
and this means that the vectors x;, x, and x, are linearly depen- 
dent. A 


2.13. The Basis of Space 


The linear (vector) space U is said to be n-dimensional 
if there are п linearly independent vectors in it and there 
are no more linearly independent vectors. The number л 
is the dimension of the space and the space itself is finite- 
dimensional (designated as U,). 

If there is an arbitrary number of linearly independent. 
vectors in the space U, then the space is infinite-dimen- 
sional. 

Any set of n linearly independent vectors of n-dimen- 
sional space is the basis of that space. 

In every space there is an infinite set of bases. One of 
them is a system of unit vectors: 


e, — (1, 0, 0, ..., 0), 
e, — (0, 1, 0, ...) 0), 


е,--(0, 0, 0, ..., 1). 


Theorem 1. Every vector of an n-dimensional space 
б, can be represented as а linear combination of the vectors 
of the basis, and that representation is unique. 

O Let x € U, and е, e,,. . ., е, be the basis of the 
space U,. The vectors x, ej, е, .. ., е, are linearly 
dependent (their number is п + 1 and exceeds the dimen- 
sion of the space), i.e. 


сох + бе + саба +... + сһеһ = 0, (1) 


where a certain coefficient c; 5 0 (0< J< п). In rela- 
tion (1) the coefficient cy 0 since otherwise 


сүе, + се, +... -F Cue = 0, 
where c, == О (j= 1), and this contradicts the linear in- 


dependence of the vectors e,, ез, ..., ел. Consequently, 
relation (1) can be solved for x: 
х= 48i + Yala +... Әлен, (2) 


where у, = --с/Со, Ya = —Calor ..., Pn = С/С. 
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Thus any vector x of the space U, is a linear combina- 
tion of tlie base vectors. 

We shall prove that representation (2) is unique. We 
assume that there is another ropresentation 


x= үе, + Үҙе; +... + Үлеп, (2^) 


different from representation (2). Subtracting (2') from 
(2, we obtain 


O -= (Va — v) Ca -H (Pa — Y) C2 — ...— (Yn — Ya) Cne (3) 


Since the base vectors е), e,, ..., e, are linearly indc- 
pendent, there must hold relations 


(ү, —у) = 0, (Ve — т) -0,..., (Yn — Yn) = 0), 


whence it follows that y, = yj, Ye = Vao .. 5 Yn = 
Yn, i.e. representation of the vector in terms of the 
base veclors is unique. Ё 
The numbers y,, Yas .. ., Yn in relation (2) are the 

coordinates of the vector x with respect to the basis еу, 
Cas ..., C. 
Consider a system of m vectors in the n-dimensional 
space 

Ky = 44,04 F 0,10 +... A- 4484, 

X4 — 045,09, F 0550, +... -]- (0,50, 


Xm = lime -F aame -F - - - tanmen- 


We write the matrix composed of the coordinates of these 
vectors so that the elements of the jth column are equal 
to the coordinates of the jth vector (j -- 1, 2, .. my 


ау] Gia .,.@1т 
A= 431 g2 .-. lam 


апі 4ла... nm: 


Let the rank of this matrix be equal to г. Then the 
rth-order minor, different from zero, is a base minor 
of the matrix А. The rows and colu..ns whose intersec- 
tion is occupied by the base minor are base rows and 
base columns. 


Та 
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Theorem 2 (on the base minor). The base columns (rows) 
of the matriz A are linearly independent and every column 
(row) of this matriz is a linear combination of its base 
columns (rows). 


Example. Given & system of vectors x, — (—2, 4, 3, 5), 
ха = (0, 1, 2, —1), x, = (-2, 7, 9, 2), we must find the linear 
dependenco of this system of vectors, determino the basis of tho 
system and represent the vectors of the system as a linear combi- 
nati n of the base vectors. 

4, (1) We form a matrix from the coordinates of the vectors: 





—2 0-2 
4 1 7 
A=) з 209) 
5-1 2 
Then we determino the rank of the matrix A using the bordering 
—2 í 
method. We take a minor M, =| 2 | zÆ О and consider tho 
minor bordering it: 
—20 —2 
Мі-| 41 171. 
32 9 








То calculate this minor, we subtract tho first column from the 
third and get 
—200 
413 
326 


since there are two proportional columns. 
The second bordering minor 


. Мі- == 








—2 0—2| |-2 0 0 
м=| 4 1 11-441 31-0 
5-4 2 5 —1 —3 














since, after a similar transformation, it also contains two pro- 
portional columns. 

Thus all minors uf the order higher than the second are zero and 
therefore the rank of the matrix A is 2 and the minor M, — 
—2 0 

41 
are linearly independent and form the basis of the system and the 
vector x, is their linear combination. Thus this system of vectors 
is linearly dependent. 

(2) We set up an equality 


гілі + сұх, + сұл; = 0, (в) 


is a base minor. Consequently, (һе vectors x, and x, 
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whence we get a system of equations 
[00а (2) 0, 
€9*5 - 051-03: 7 = 0. 


Wo fnd the expression for сі = —c from the first equation and 
substitute it into the second equation: 


--4сҙ + са -H Teg = 0, с) = —3ey. 


We зей су = 1 and then c, = —1, с, = —3. Substituting the 
values of су, c4 and c, into relation (ж), we get 


—X, + 3x, + хә = 0, or x; = x, 3x, 


Thus the vector x, is represented as a linear combination of the 
base vectors x, and х,. This representation is unique. The numbers 
(1, 3) are the coordinates of the vector x, іп the basis (x; X5). A 


2.14. The Transformation of the Coordinales 
of a Vector upon a Change in the Basis 


Let {e} — (e, е,, ..., е,) and (f) = (fS, f, ..., E) 
be two bases of the same linear space U,. Every vector 


of the new basis {f} has coordinates Sij, Saj . . ., Snj 
іп the old basis (е) and in the designation of the 
coordinates s,; (i = 1,2, ..., n) the first index denotes 


the number of the old base vector and the second index 
denotes the number of the corresponding new base vec- 
tor. Consequently, 

fy = 5€ F Ses +... + $504 (/--1,2,..., n), (1) 
or 


[fe = sent sus Jo eee TSP T 
f, 525,0, F 55505 + ...-bSncenry А 
(2) 
fj = 5140, пе... ci San€ny 
where 
811 851 +--+ ӛлі 
5 | 512 “22 ++. nz 


. Sin Әп.» Snn - 


is a nonsingular matrix since det 5 0 (otherwise the 
rows of this matrix and, hence, the vectors |, £j, ..., |І, 
would. be linearly dependent). 

The matrix 4 is the matriz of the transformation of the 
old basis into a new one. 
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Let x be an arbitrary vector of the linear space //, 
being considered. We designate the coordinates of this 
vector in the old basis as z; and its coordinates in the new 
basis as y,. lt is evident that 


X — YF, yf +... yu = ze Heres +... d rues, 


п 
" 

ог х= 2 ‚ме = 2L уу. 
= j= 


ul 
Taking relations (2) into account, we have >) fj- 
ілі 
п 
У! sici, whence, substituting the expression for lj, we 
іі 


т 7 n т mh 
1 . 
gel x= У) ze; = У) yi 2) эуе, = 2) e; >) 80у]. (3) 
i=1 j=l іші іші ј=1 
Consequently, by virtue of the linear iudependence 
of Ше vectors е), е,, ..., e,, we find that 
"n 


Zi = У sw (і--1, 2, ..., т, 
= 


Тізезіуі + Saed secl Snin 
ог Z= 53041 F Seyot ... +Snayns (4) 
Tn = SinV1 t пуз -e -FH nnn: 
Relation (4) can be written in matrix form as 
x = Sy, (5) 
i.e. in the old coordinates (in the old basis) the vector is 
equal to the trausformation matrix 8 multiplied by the 


vector in the new coordinates. We premulliply relation 
(5) by the inverse matrix 8-5 


Sx = y, or y = $7x. (6 
The matrix 8-1 has the form 


81/4 8/4... 81/4: 
Sau | 521/9 5/9... 5114 


5п1/ 83/4 ... 5пъ | 
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where d is the determinant of the matrix S (d се 0 since 
S is a nonsingular matrix) and 5;у are cofactors of the ele- 
ments of the determinant d. Then 














Su S S 

m= nd i Ta- ...-- F Tn, 
" " $, 

yc Ter zd > Z4d-...d- i Zn, (7) 
s 5 2. 's с... 

Уп = 1 Ti E^ T+ + T Tn 





Relations (7) are formulas for transition from the coordi- 
nates z; of the vector x in the old basis to the coordi- 
nates y; in Lhe new basis (i = 1,2,. . ., п). The transition 
from the coordinates т; to the coordinates y, is carried oul 
by means of the matrix S-! which is the inverse of the 
matrix of the transformation of the old basis into a new 
onc. 

Example. Find the coordinates of the vector x = (0, 0, 0, 1) 
in the basise, = (1, 4, 0, 1), e, = (2, 1, 3, 1),e, = (1, 1, 0, 0), 
e, = (0, 1, —1, —1). 

^ (1) We compose a matrix 5 of the transformation of the old 
basis inLo the new ono: 


121 0 
444 4 
S—-losao atl 
110 —4 


(2) We find the inverse matrix 
511 ӛзі S31 Sa 
1 Sig Soo S3 Saz 
det S |8, 5,3 S 541° 
Su Su Sq 844 


We have 
124 Of [4 24 0 
144 4| јао 4| |0-! 1 
448-і узо | 4|7|o зо —14|7|0 3-—1 
по lt 10-4] И 1il 
р-а 
~ 5 |2 


We have transformed the determinant. of the matrix 5 іп the 
following way: first we subtracted the first row from the second, 
then expanded the determinant obtained according to the elements 
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of the third column, and finally expanded the resulting determinant 
according to the elements of the first column. 
Wo calculate the cofactors: 








































































































44 14 44 4 
84-|30--1|-«2; 8,)-- |0 0 —1|=1, 
10-41 40 —4 
44 1 144 14 
$4,2|0 3 —1|25|0 3 —1|— —6, 
11 —1 00 —2 
1414 
03 
=—/0 3 0|-.— =з 
Su 140 К " 
24 n 
Su= -|39 | Т - -2 
40 —4 - 
441 0 
sa= [оо - |, zie t 
10-41 - 
12 0 1 2 0 ) 
Sa= -|03-4|--04 3 10|] ? —1|——4, 
14-і 0-1 —4 —1 —1 
121 
$47 |030|-|73|- s, 
110 
21 NQ . | 
51-141 1l= (the first row is cqual to the sum ol 
317 40 —4 the second and the third row), 
441 0 11 o 4 
$.4—-—|1 Ц--|00 41-4) |= = 
10-4 10-1 - 
42 Of 1420 12 
$эу= |11 11121322, 
11 —4| 1220 
121 1 21 a 
Sa = —|111|2—|0 —10|2— өлме 
140 1 40 1 
21 0 210| ,, 
Su=—|1 4 |= |1111 |=—2, 
30 —1 410 1 
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11 a 
$45-|11  1|-! (there are two identical columns), 
0 0 —1 
12 ü 12 0 
Sac ]11 1|е--[14 n E 2 1-2, 
93-4 93-4| 114 
121 
84 -|11 11-0, 
030 








Consequently, 
2--2 0 --2 
1 1-1-4 0 
21-6 4 2 9 
3 --3 —1 n 
(3) From formula (6) we find the coordinates of the vector x 
in the new basis: 


8-1... 


2 —2 ) —2 0 
a 1 1—1 —1 0 0 
y 57x-- y|—6 4 23 2] fa 
3 —3-1 ü -4 
222 С 
1 of 9 
727] 2[=| 11" А 
ЖЕЛЕ _ ou 
exercises 


1. Calculale AB if 


4 —-23 231 
(a) as —1 | B- f zal, 
4-21 218 
1—32 256 
(b) ^|: --4 i, ZI 2 s. 
2-53 132 


2. Calculate 2 (A -|- B) (2B — A) if 


23 —1 5-40 05 
(а) А-| 45 2|. s= о 43], 
—10 7 2-24 








45-2 24-1 
(b А-|3-1 |, a= oa 31, 
4 2 7 57 3 
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3. Find the product XY if 
9 





1 
7 
(а) X=} 4]. y=[12 —2 —3) (b) x=] | Y 544 5), 
2 238 
12 
7 
(с) X110 17854, Y=] 5 
4 
10 
4, Find the product AX if 
—1 
2 —1 —3 0 4 1 
()А-|7 2 5 5 20|, х-р 2 
3 4 1 —7 —1 3 
0 
12 —4 --2 
(b А-|308-2|,Х-1-31. 
22 —3 ES 
5. Calculate the determinants 
E 11—2 3 
1 3-4 тв 4 4 
(a) d= u 1 1}, (b) d— 24 6 —3l* 
2-5 8 56 8--4 
1.6 5.4 —7.7 —3.1 
1,929. 14-23 өз 
(0) 4-15; 5.9 2.7 —T.9| 
0.7 1.9 —8.5 4.8 
6. Calculate А-1 for the following matrices: 
- А 271 4 
1—32 590 —4 
(a) А-|8-404, (b) A=f 349 1], 
2-53 684 3 
1 0 0 0 
0 2 00 
(09 4=|5 -3 40 
3 2-13 
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7. Find AB, where 


4 41 3 14114 
0 —13 —4 1423 
А-і; 10 2|,8-|41 403 el 
1-25 4 6 10 1 4 


using two techniques: (a) by partitioning A and B into square 
blocks, (b) by partitioning A and B into blocks by bordering. 

. m Calculate А-1 using the partitioning into blocks and border- 
ing 1 


1 2 8—2 3—2 2 0 
2—1 —2 —3 2 4 4-2 
а) A=13 2.4 a9]: (4=[3 1 2 4 
2-3 2 1 1 2-4-4 


9, Expand the matrices given in Exercise 8 in the product of two 
triangular matrices and invert them using the expansion of matrices 
in the product of two triangular matrices. 

10. Solvo the following matrix equations: 


0 3 —1 76 —3 
(а) X 2 —1 2|2[—83 6], 
.—8 1 4 2419 13 





7 76 —3 —8 —10 —4 
(bh) | вз e|x— | a 44 —10|. 
449 13 48 2 9 
11. Calculate the ranks of the following matrices: 
2 4410 
2-13-24 2 410 
(a) А-|4-25 17], (b) B= —1 —2311. 
2 —11 82 5 1064 . 
0 072i 


12. Test tho following systems of vectors for linear dependence: 
(а) x, = (5, 4, 3, х, = (3, 3, 2, xy = (8, 1, 3, (b) х; == 
(1, 0, 0, 2, 5), x, = (0, 1, 0, 3, 4), x4 = (0, 0, 1, 4, 7), x, = 
(2, —3, 4, 11, 43). 

13. For tho system of vectors x, = (5, 2, —3, 1), x, = 
(4, 1, —2, 3), x4 = (1, 4, —1, —2), x, = (3, 4, —1, 2) find the 
basis and express the other vectors in terms of the base vectors. 

14. Find the coordinates of the vector x = (1, 2, 1, 1) in the 
basis e, = (1, 1, 1, 1), e; = (1, 1, —1, —1), eg = (1, —4, 1, 
—1), ea = (1, 7-1, —1, ). 


Chapter 3 


Solving Systems 
of Linear Equations 


3.1. Systems of Linear Equations 


In the general form a system о) m linear equations in n 
unknowns is written as 


(шті -- &1222 + ... 3-031424 + -F адь b, 


| 283171 -]- agg- -+ ajz] -|-----|- Gan tn — bz, 

M I 1 
{en F jot, 4... b ат) de eese dintn = Dbi, (1) 
| mii amzTa + ---Гату1)4:...-атһТһс- bm. 


Тһе equations of the system are assumed to be enumerat- 


ed, i.e. the first, the second, . . ., the mth. The numbers 
Тұ T4, ..., Ту аге the unknowns of the system and 
ац» 619, .. -, Amn аге the coefficients of the unknowns of 


the system. 

The coefficient of the unknown z,; in the ith equation 
is designated ps aj, where the first index i indicates the 
number of the equation which contains this coefficient 
and the second index j indicates the number of the 
unknown in which this coefficient is. For instance, the 
coefficient a,, is in the second equation of the system іп 
the unknown 23. 

The numbers b, ba, ..., Um are constant, or free, 
terms of the system. 

In the abbreviated form system (1) can be wrillen as 


У а;уху — b, (і--1, 2, 4... т). (1°) 
1=1 


А solution of the system of linear equations (1) is апу 
set of numbers «у, @,, .. ., ад, which, being substi- 
tuted for the unknowns z;, z;,. . ., Zn into the equalions 
of the system; turn all the equations into idontities. 
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The system of lincar equations (1) is consistent if it has 
a solution. If a system of lincar equations has no solu- 
tion, then it is inconsistent (or incompatible). 

A consistent system of linear equations may have one 
solution or several solutions and is said to be determinate 
if there is one solution and indeterminate if there are 
more than one solution. 

Two systems of linear equations with the same number 
of unknowns are equivalent if they are either both incon- 
sistent or both consistent and have the same solutions. 

Пеге are three types of the elementary transformations of 
a system of linear equations: 

(1) permutation of two equations of the system, 

(2) muitiplication of both sides of an equation of the 
system by any nonzero number, 

(3) addition to (subtraction from) both sides of one 
equation өз tie corresponding sides of another equation 
multiplied by any number. 

We can prove that elemenlary transformations turn a 
given system of equations into an equivalent syslem. To 
perform elementary transformations is the same as to 
express one unknown in terms of the others. 

A system in which the constant terms bi, Das ..., On 
аге того is a homogeneous system. 


3.2. The Kronecker-Capelli Theorem 


Consider a system of linear equations 


43121 + алата T d 41n 70 == 01, 
83121 azt d- ...- Ganz = 5, (4) 


атут таг, |... -атпп = bm. 


To establish the conditions of consistency of the sys- 
tem, it is necessary to introduce the concept of the ma- 
irix of a system and the augmented matrix of a system. 

The matriz of system (1) is a matrix composed of the 
coefficients of the unknowns of the system: 


411 444. Gin 
A= аз] 38 .. gn 


Gmi ат атп 
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If we add a column of constant terms to the matrix A, 


we get a matrix А which is known as the augmented ma- 
trix of system (1): 


411 буз ... O1nb, 
A — 441 49 2... Ganba 
ат "ma amnbm 


It is clear from the definition of the system matrix A 
and the augmented matrix A that their ranks г (A) 
and ғ (A) are either equal or the rank r (A) is larger by 
unity than г (A). 

The question concerning the consistency of system (1) 
is answered by the Kronecker-Capelli theorem: £he sys- 
tem of linear equations (1) is consistent if and only if the 
rank of the augmented matriz A is equal to the rank of the 
matriz A, ie. when г (A) =r (A). 

_ Example. Test tho following system of linear equations for con- 
sistency: 


124-32, — 2, 
24—2r1,— — 3, 
42; ]-9z4— 11. 


A (1) We set up a matrix for the given system and calculate 
its rank: 
7 


т 3 
А-|1 --2|, r(A)=2, since Мі-!|, 


4 9 
(2) We set up an augmented matrix for the systemnt 


7 3 2 
-|i —2 — 83|. 
4 9 1 


Since Mj + 0 and the minor bordering it 





3 
7s. 
-2|% 


7 3 2 
M,—detA-|1 —2 -3|- 
4 9 MH 


(the first row is equal to the sum of the second row multiplied by 3 


and the third row), it follows that r (4) = 2. Thus? (A) = г (A) = 
2, i.e. the system is consistent. A 


Ch. 3. Solving Systems of Linear Equations 11 


Corollary 1. If system (1) is consistent and the rank of 
the system matriz г (A) =r is equal to the number of 
unknowns n, then the system has a unique solution. 

Corollary 2. If system (1) is consistent and the rank of 
the system matriz r (A) = г is lower than the number of 
the unknowns n, then the system has an infinite number of 
solutions. 


3.3. Cramer’s Rule for п Linear Equations 
in п Unknowns 


Consider a system of linear equations in which the 
number of equations is equal to the number of unknowns 


[one bene +... фахр =), 


аа +... `} onn 0, (1) 
| anizi Hanara + Балп ~ by, 
and 
ауу 4149 fin bi n 
421 33 >>. бап by та 
А- Qbe| #*|,х= 
- Өлі 4па2:.- "nn Lb, | Lan | 


are the system matrix, the column of constant terms and 
the column of unknowns respectively. We assume that 
the determinant of the system 


411 413 --- біл 


d _ [42231 а»... Gon X 0. 


If now we successively replace in the determinant d 
the columns of the coefficients of the unknowns т, 
( =: 1, 2,..., n) by Ше column of constant terms 5, 
we obtain determinants 


b, ауу ..- dy n-1 Tin 
ba ауз -.. da, n-1 боп 





1, = 


bn ала... ân,n-1 Ann 
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ауу бү... 44-і (“іп 
d. = азу 05 ... do,n-1 бәп 
17 ee > o è > o o ò o е 
апі Dn ... Gn,n-1 ann 
eee © 9 o, э өе © © е + е а 
а аш... bi Gin 
ааа == |921 doa -ba an |, 
ânı айпа... On ânn 
411 41ҙ...41т-і бі 
d, = |1 dos >.-4ҙл-і Da |, 
апі anz +--+ ün,n-1 On 








respectively. 

Cramer’s rule, A system of n linear equations in n un- 
knowns, whose determinant is different from zero, is always 
consistent and has a unique solution which can be found 
from the formulas 

I1 = dd, Та = а,/а, e.e Tnm = а,4/а, 
Zn = d,/d. (2) 
Formulas (2) are known as Cramer's formulas. 


Example 1. Uso Cramer's formulas to solve the following system 
of linear equations: 


° z4-- 23-225 — — 1, 
221 — I3 + 213 = —4, 
Az, + та 45у — —2, 


A (4) We calculate the detorminant of tho systom: 


1 1 2 1 1 1 
4-|2 —1 2|-2|2 —1 1|—2(—2-4F44-27FÁ —4— 1) — 6. 
4 14 4 12 


(2) We calculate the determinants composed of the cocfficionts 
of the unknowns z;, zs, ту: 


—1 12 —1 11 
А4-|-4 —1 2|-2|—4 —1 1 
—2 14 —2 12 


—2(2—2—4—2--1--8) —8, 
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1 —12 4 —4 14 1-1 14 
dj— 2 —4 2|-2|2 —4 1|—4|2 —4 1 
4 —2 4 4 —2 2 2 —1 1 
-4(-4-2--2--8-1-2--1)-<12, 
4 1-1 
dy— 2 —1 —4|-— (2—16 —2—4-E 44-4) = —12. 








4 1-2 


(3) Using Cramer's formulas (2), we find the solution of the 
system: 


ху dyfd=6/G=1, ға ~defd==12/6—2, sa= —12/6- —2. А 


Example 2. Use Cramer's formulas Lo solve the following system 
of linear equations: 


271--7; 1-2; |-Эт4с- —1, 
11-17; — їз йт — 0, 
Әт--13--1,-- 24-4, 
21—32 -|-Әӛг,-:- --5. 


A We find the determinants d, d,, da, da and d4 expanding 
them into minors according to the elements of the last row and then 
applying the rule of triangles: 


2-1 1 3 
124-4--4 —1 1 3 
4:24 4 р 1—1-4^ 
1—3 0 3 C4 0 4 
2 1 8 2-1 1 
—3]1-1 —4] F3] 1. 1 —4| =(--4)-0—-3-5 43.8 = 45 
3 4 4 3-4 14 














(the first and the third determinant are zero since they have pro- 
portional columns), 


—1 —1 1 3 




















6 1 —1 —4 —1 1 3 
a= ga gg fed} 11-4 
-5—3 wu 3 —1 1 1 
2404003 —4-4 1 
—8| 6 -4--4/43] 6 4 --4/=5-0—3-54 3-0— -- 15. 
4 4 1 4 —1 1 
2—4 14 3 
4 6 —4 —4 -і 1 3 
вз 4 4 d4|--| 96-14 
1—5 0 3 4 1 1! 





8--0104 
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2 4 3 2-4 1 
—5/4 —1 —4/43]4 6-4|--41.5-5.54-3-10--0, 
38 4 1 з 4 1 
2—1—1 8 
11 6-4 -і-і 3 
d=] 4 4 5| 1 8—4 
1-3-5 3 —1 4 1 
|9 —1 3 2—1 3 2 —1 1 
—54 6 —4|-5]1 1—4/4+3[1 1 6 
із 4 4 3-4 1 3 —1 4 

















z(—1):.5—3-15-4-5- (— 5) --3-10 — — 45. 
2-41 1-41 








1 4-1 6 —1 1-1 
d—13 4 4 4|7-| 1-1 6 
2 1—1 2-1 1 
-8|1-і1 6|-5|1 1-1 
3 1 4 3-4 4 














== (--4)-0—3- (—40) — 5.0 — 30, 
Using now Cramer's formulas (2), we get the solution of the 
system: 
z, = d,/d = (—15)/(—15) = 4, z, = d/d = 0/(—15) = 0, 
т = d/d = (—45)/(—15) = 3, z, = d,/d = 30/(—15) = —2. А 
Note that the solution of a system of linear equations 
via Cramer's formulas is very cumbersome. In practical 


calculations other methods are usually used lo solve 
systems of this kind. 


3.4. Solving Arbitrary Systems of Linear Equations 
Let 


01121 3-015734 t -+ білі = bi, 
03121 5524 + ...4-dontn = by, 


E Gm171 4- Uma, - E Gmntn = bm 


be an arbitrary system of linear equations, where the 
number m of equations is not equal to the number п of 
unknowns (m Æ n). 


(1) 
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Wo assume that system (1) is consistent, i.e. r (A) = 
r(A) =r and r< min (n, n). Then in the matrices 
A and A of the system there are r linearly independent 
rows and the other m — r rows are their linear combina- 
tions. Interchanging the equations, we may attain a sit- 
ualion when these r linearly independent rows occupy 
the first r places. 

It follows that any one of the last т —requations of 
system (1) can be represented as the sum of the first r 
equations (which are linearly independent or base equa- 
tions), taken with certain coefficients. Then system (1) 
is equivalent to the following system of r equations in n 
unknowns: 


ау 21573-- ... -|-@intn = by, 
| 3121 -Fafa -t -- . аз = bg, (2) 


. 
X ағ121-|-4уҙ2,--...- arn Zn 0 


We assume that the rth-order minor composed of the 
coefficients of the first r unknowns is nonzero: 


411 412... (ір 

-. |221 боз ++, Zor 
М, B #0, 

Gr] го... Orr 


i.e. is a base minor (see 2.13). In that case the unknowns 
whose coefficients constitute a base minor are base un- 
knowns and the other n — r unknowns are constant un- 
knowns. 

In each of the equations of system (2) we transfer all 
terms with constant unknowns r,44, Trpo .. ., 1, tO 
the right-hand side. Then we get a system 


83121-01523 t -F Oy PZ, 

== by — 1,741.2 p41 — Et reat rag — 55 inn, 
45171 |: 45579 t+ -> -F aorTr 

= bg — Gy psi Zp — lorara ~ 0+" 4ур Тп, (3) 


+ э э 4 а «+ 4.1.40. э а ж 


а,121--4ғ2-І-...-- arrr 
= bp — Gyre Tran — rire 1 ад — 7: irnn, 


which contains r equations in r base unknowns, Since Lhe 
determinant of system (3) is a base minor М, #0, 


116 Computational Mathematics 


system (2) has a unique solution for the base unknowns 
гр Тә, 2.5, T, Which can be found from  Cramer's 
formulas. Assigning arbitrary numerical values ту = 
Сі Траст бо)... 2 Ig = Cg ; lo the constant un- 
knowns фуу Zrtos e, Tny WC gel a special solution 
of the original system (1). 


Example. Solve the system of three equations in fonr unknowns 


32, — 23+- 524+ áz4 — 2, 
| (ar, -— Ázg |-Ат,-| 374, = 3, (*) 
9a, — 6z, i- 324: |- 224 -- 4. 
A We test the system for consistency, Jor which purpose we com- 
pose matrices A and A: 


3-254) 1383-2542: 
А-|6-443|, А-|6-4433|, 
9-6 32 9 —6324 


Then we determine the ranks of these matrices using elementary 
transformations: 

(a) since the first and the second column are proportional, we 
delete one of them (the second), 

(b) we multiply the first column by 1/3, 

(с) we multiply tho result in succession, by ( -5) and (--4) 
and add to the second and the third column respectively, 

(d) in the matrix obtained, two columns (the second and the 
third) are proportional; we delete one of them (the third) and mul- 
tiply the second column by —1/6, 

(с) we multiply, in succession, the first row by (—2) and (---3) 
and add the result to the second and the third row respectively, 

(f) wo multiply the second row by (—2), add the result to the 
third row and delete the zero row obtained. 

We have 


3—254] (а) [3547] (DI154 

A=|6—443] ~]643] ~/243 

9 —632 932 332 

(pt o0 o] (9191 (Qo pto] (D 
~ |2 —6 -5| -1|94| оя “ГОЛ 
3 —12 —40 32 02 01 


Evidently, the rank of the last matrix is 2: r (A) = 2. 
We siiuilarly transform the matrix А: 


_ {3—2542 3542 1542 
А-|6 —4433]/~]6433]/~/]2433 
9 —6 324 9324 3324 
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1 0 9 0 1 0 1 9 
|2 —6 -5-1|-|92--4|-40--1 
3 --12 —10 —2. 3-2 0 —2 


40 
»|n1l- [i 1 . 
0n 01 
Consequently, r (A) = 2. 

Thus r (4) = r (A) = 2, іс. the system is consistent. 

Since the rank of the systern is 2, it follows that the maximum 
order of the nonzero minor із 2 and the system has two base un- 
knowns. Wo find some nonzero second-order minor, such as, for 
5.4 
4 3 
the unknowns zy and r4. Consequently, су and e, can he considered 


to he base unknowns and z, and гу to be constant unknowns. 
System (*) is equivalent to the following systern: 


instance, a minor M, =- Æ 0, formed by the coefficients of 








| 3z,:—-32,-|-5z4 | 4г,--2, (**) 
6zi—4Àz, |-Ar4 ҺӚг,--3. 
We transfer the constant unknowns to the right-hand side 
{ Bra- 4c, —2 —3z, |-Әғу, (***) 
Arg 1-3, -3--бгі | 4ey. 


and solve system (3) using Cramer’s formulas: 





D 4 
4- i3 —45 -10- —1, 
2--3гі--2 4| ap . . LA 
d; -- 3 —6r,-[-Ár, 3 -=3 (2 —32,-]- 222) - 4(3--бгі Hárs) 
= — 0 БЕЛ - 1t rg, 
o |5 2-34, -24|. & CAELO 5 
d, — 4 3- Gr, társ 5 (3-— Gr, | 4r) - 4 (2 -- 3r, -- 273) 








-7--А8ғ1-Һ 1270, 
r4—d4/d = 6-- 15r, -|]-10za, z, =d,/d = — 7 4- 18r, -- 0273. 


The solution obtained, in which the base unknowns rj and т; 
are expressed in terms of the constant unknowns z, and г, is tho 
general solution of system (*). Substituting the arbitrary values 
of the constant unknowns into it, we get various special solutions 


For instance, if cp 7 0, гу 0, then су -È ry — --7, if e, 1, 
ғ, -- 2, then шу-- 11, гу 13, ele. The сопесбіоія of numbers 


(0, 0, 6, --7), (1, 2, 11, 13) ete. are special solutions of system 


(0. A 
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3.9. Homogeneous Systems of Linear Equations 


Consider a homogeneous system of m linear equations 
in n unknowns: 


41111 + 44523 Б... Балта 20), 
a311 Fiata -- ... апр =", (1) 
8m121- &ma23 d- - «1 атга =". 


Since the addition of a column of zeros does not cliange 
the rank of the matrix of the system, this system is al- 
ways consistent by virtue of the Kronecker-Capelly theo- 
rem and has at least a zero solution (гу = x, =. - 
Zn == 0). If the determinant of system (1) is nonzero 
and the number of equations of the system is equal to 
the number of the unknowns, then, according to Cra- 
mer's rule, the zero solution is unique. 

In the case when the rank of the matrix of system (1) 
is lower than the number of the unknowns, i.e. r (4) « n, 
the system has nonzero solutions in addition to the zero 
one. To find these solutions, we isolate in system (1) ғ 
linearly independent equations and delete the other equa- 
tions. On the left-hand side of the isolated equations we 
leave ғ base unknowns and transfer Ше olher n —r 
constant unknowns to the right-hand side. Then we ar- 
rive at a system 


{ ауүтү--ауулу-}-...-Е@үртр 
= — Ml, r41T pa 01, рар 07 Шуп 
G5AT17|- 055735 d- ... -]- 4,7, 
= —Us.redIrel — бу, газ Араз 77 +++ UsnTmn, (2) 


dpiI4 -arzt +... +F 4, r7, 
~= 070, ype Tre — Or ғә Tray — >>. ÜrnTn, 
solving which by Cramer’s formulas, we express ғ base 
unknowns ту, 205, . . ., zr, in terms of n — r constant un- 
knowns 2,4) Zpig. +- -y Zne 
System (1) has infinitely many solutions, among which 
there аге linearly independent solutious. 
А fundamental system. of solutions consists of n —r 
linearly iudependent solutions of a homogeneous system 
of equations. 
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Example. Given a homogeneous system of equations 


221-423} 5г,4-3г, —0, 
DEM 4zg d- 27, =0, 
421--81, + 172, 4- 1424 — 0, 


find its general solution and tho fundamental system of solutions. 

^ (1) The number of unknowns here n — 4, the number of 
equalions m = 3. We calculate tho rank of the system matrix using 
elementary transformations: 

(a) delete the second column since it is proportional to the 
first column, 

(b) multiply the third column by (—2) and add the result to the 
second column and then multiply it by (—3) and add it to the 
first column multiplied by 2, 

(c) delete the first column since it is proportional to the second, 

(d) multiply the first column by 3 and add tho result to the 
second column, 

(e) multiply the first row by 5 and add the result to the fourth 
TOW, 

(f) delete the third row and divide tho first row by (-—1) and 
the second row by 2. 


We have 
2--4 5 3 (а) [2 5 37 (Г —5—1 3 
A~ [3 —6 4 2 re 3 42 |~ 0 a2 
4 —8 17 11 .4 17 11 —25 —511 





()r —1 3 ()p—1 9 (e)[—1 n 
~ 0 2 ~ 9 2 ~ 0 2 
—5 11 |—5 —4. 0 —4 
(pro 
7 [i |J 

Since r (A) = 2, i.e. r < шіп (m, n), the given system has 
a fundamental system of n — 2 — 4 -- 2 = 2 solutions. 

(2) We shall seek the general solution of tho system. Wo find 
the base minor, i.o. a second-order nonzero minor. Such is, for 
instance, the minor composed of tho coefficients of ry and г, in 
5 3 
4 2 
2-60, Leaving the base unknowns гу and z4 on the left-hand sido 
amd transferring the constant unknowns z, and z, to the right-hand 
side, we arrive at a system 

{ 9z4-|- 324 == — 224 |- 4ге, 
Arg--2z4, — —3ry-+ Bry. 
Its solution, found from Cramer’s formulas, has the form 


the first and the second equation of the system: M, == 








гу = --2.52, -F ба, 
t, = 3.52, + Tr, 
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(3) To obtain a fundamental system of solutions, we must find 
any two linearly independent solutions of the system (sinco п — 


r = 2). Setting first г) = 1, z} = 0, wo have ry == —2.5, z4 — 3.5; 
selling then т, = 0, 2, = 1, we get т, = 5, т, = —7. Thus the 
fundamental systom of solutions has the form 
1 Ü 
9 1 
R-|-2s5] =} s] 
3.5 -7 


and tho general solution is R = сүй, + саНҙ, where сұ and с, 
are arbitrary numbers. 

Assigning different values Lo c, and су, we can gel any solution 
of tho given system. 


Assume, for instance, that ху = 1,2, = 2. Then гу = —2.5-14- 
5.2 = 7.5, т, = 3.5.1 — 7.2 = —10.5. The special solution 
1 
2 
R= 7.5 
— 10.5 


obtained is a lincar combination of the solutions which constitute 
a fundamental systom for с, = 1, с„ = 2, R= ft, -|- 210,. A 


3.6. Basic Elimination Procedure 


Consider a system of n linear equations in 2 unknowns 


( 81124 + 01523 t -+ G1qzq + -Hainin — ners 

05121 + 25375 + TEL TM 4...4 апп —@,п+1› 
az “азада... - (t) 

арі, -@рз +... 1 4pqtq-F- -- F4 pnfn = ар,.пъл, 


апі пә... апаа... 4nnTn — айны. 
We sel up an augmented matrix of system (1): 


411419614 -.. 017 :-- An@inei 7 
21022053. ... og s+ Оцу, uel 
A= -- 
pipa p з * | pq|-* s 4 pu pinea 
EP 


4184203: пд @nn@nintt a 
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Wo choose the largest in absolute value nonzero element 


ам Of matrix A which does not belong to the column of 
conslanl terms. This element is known as the pivot ele- 
ment. We calculate the multipliers m; -= —a;,,/a,, for 
all rows with the numbers i 35 p (the plh row which 
contains the pivot clement is known as the pivot row). 

Then we add, to every nonpivol ith row, the pivot row 
multiplied by the corresponding multiplier m; for that 
row. For example, 

iq 


D. 
DD- sayy ар ar 
Pq 





Ang 


WD а„—а,„, and so on. 
- - nq 


We obtain a new matrix, in which all the elements of 
the qth column, except for ару. consist of zeros: 


ay 
by ара —- 0 
IU pe , 

П ера 








Deleting this column and the pivot pth row, we get a new 
matrix B®, the number of whose rows and columns is 
smaller by unity. We repeat the operations for the matrix 
BO and get a matrix ЗО) and so on. 

We thus construct a sequence of matrices A, BO, 
Вә)... B-D, the last of which is a binomial row 
matrix (the pivot row). To lind the unknowns г, we 
combine all the pivot rows, beginning with the last row, 
into a system. 

This method of solving a system of linear equations in 
n unknowns is (іш basic elimination procedure (also 
known as the method of pivot selection and as pivotal- 
condensation method). The necessary condition for its 
application is that del А Æ 0. 
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Example 1. Use the method of pivot selection to solve the 


system 
32-22, 4- 7, — 5, 
| 22, -|-5zg -- лу== — 3, 
221+ 22+ 323 == 11. 


^ (1) We compose an augmented matrix A of this system, find 
the pivot clement and calculate the multipliers т 


321 5 
|: [5] 1 ^4]. 
213 11 


44» = 5 is the pivot element, m, — —2/5, my = —1/5. 
(2 We seck tho matrix ВО), We have 

а » 2 11 2 3 

WP Rev. Р 11.625 
2 3i 1 8 

Му 5+3 т=з, 0=2—2. ===, 

1 14 1 58 

2-3-1: eae, bey — 114-3. Rp. 


4/5 3/5 31/5 
во =[ 8/5 [1275] sus] 


Here bU = 14/5 is the pivot clement, m, = —1/14. 
(3) We seek ВО). We have 


qn. 11.8 L 4,91 58, 9 26 
"US $44 T7T' 5 5 57 1 
BO). |13/7 26/7). 


(4) Using the pivot rows, we arrive at a system 


( 2т|-Е5ту-{- шу --3, 22,-|-5z4-4- z4— — 3, 
ty (14/5) xy = 58/5, or Ac4-F 7га — 29 
7, — 26/1 137, 26. 

The reverse operation yields г, = 2, г, -- 3, z, = —2. A 


'To solve systems of liuear equations by the method of 
pivot sélection, we can use the scheme presented in 
Table 3.1 (the pivot elements in it, which have been 
chosen arbitrarily, are framed and the pivot rows are 
labelled by roman ligures 1-1У). 
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Table 3.1 
Columns of the system matrix [columns of the system matrix | 2 | T | 9 
т 5 а> 2 
i Ер z Se | 5 
ee ee | :# 
тү 411 а aig 414 415 > 41) 
421 аз [аза | 024 a25 У азј И 2 
т, 031 032 O33 азд аз; y аз) 
na 444 44з 043 444 445 АМЕН ЕЕЕ ах) 
му | [йр] ae мр 2 ap 
mit? | P | ыр bsp | bgp Ум 1 | B® 
ni? | bu "трт тнл, do ыр bay’ | MP NS) 
(2) (2) (2) m 
[2] НЫ MUS quo но 
mer | bg bg | op y go 
: S! 3) 
"up ||] | ejeje yp | 570) | ту so 


Example 2. Use tlie method of pivot selection to solve the system 
г --2r4 | 3z4d- Áz4 — 5, 
2r, r, --2z4-F 304, — 1, 
3z,--2z,-- z34-224 — 1, 
4z, 4-32, -2r,-F- z4, = — 5. 


А The solution is given in Table 3.2. 
Thus we obtain a system 


— Za 2.8, 
— (4/3) z4-— (2/3) т; =- — 2/3, 
(15/4) 11-- (5/2) г,--(5/4) Та =: — 25/4, 


ack 26d Вг) + ary = 5, 
whence we find that z, = —3, т, = 2, др = —2, 2, = 3. Д 
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Table 9.2 











Columns of the system matrix е 
т S. Pivot | Ma- 
' . ЯН rows | Lrices 
X1 Xg хә Xi 85 
1 2 3 | [4] 5 15 
--3/4 2 1 2 3 1 9 І A 
--1/2 3 2 1 2 1 9 
—4A 4 3 2 1 -5 5 | 
—4/3| 5/4 —1/2 | —1/4 —11/4 | —9/4 
-—-2/3| 5/2 1 —1/2 --3/2 1 HI | «0 
[15/4] ) 5/2) 5/4 --25/4 | 5/4 





|=4/3|| —2/3 
-1/2 —2/8 | ~4/3 


| | | Д i | | | 


3.7. Solving Systems of Linear Equations 
by the Gauss Elimination Method 


The Gaussian elimination is the most popular method of 
solving systems of linear equations. It is a special case 
of the basic elimination method when the upper left 
nonzero element of the system matrix being considered 
is chosen as the pivot clement. 

Here is an example of solving a system of four equations 
іп four unknowns by this method. Consider a system 


І 
| -2/3 | 8/3) | | pen 








4117; -|- 04573 -- 01573 + 01474 = 245, 
БЕРЕТ ЕРТЕН ТҮЗЕТЕ (1) 
(шып "F-43372 |-23353-- 43474 = 435, 

44111-Б G4272-|- 04473 + 04474 = 245. 


We shal} eliminate the unknown z, from all equations 
of system (1), except for the first equation. We call zi 
the pivot unknown and the coeflicient ау, the pivot coef- 
ficient. Dividing the first equalion by а), (this is possible 
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if a,, Æ 0), we get 


a a ais 
a T т, р —— 3 T, l. 14 T,— 15 
411 


% 
wan 7^5 ап 














We designate alan = уз, uua, == Das, а/а, = bis 
a, 5/0; == bj; and, in general, b;; = арау (j >> 1). Then 
the equation being considered assumes the form 


ху | Mate + Piata -A Dirata — Dim (2) 


or 


a, = bis — bigota — уза — Diam. 


To eliminate the unknown ғ) from the equations of 
system (1), we perform the following transformations. 

(1) We subtract equation (2) multiplied hy a,, from 
the secor! equation of system (1), 


0:17, A- 542, F- 43) -F 63,2,-- 46 


— ауу — 05101529 ~~ 0,104374 ауда = — 821b 15 


Фаш -, 
(az= 31013) ty | (аз аза) Ta l- (024. 7631014) т, 7 (43, адб) 


designate 
(0. — мә 
аз» — Әзіз 05 бру; ax — ада T пуу, 
-- өн 
аза — 31044 = буе) Qas — аль — ah 


and rewrite the resulting equation in the form 
adir, + 49%; -|- ayer, — aS T 
(2) From the third equation of system (1) we subtract 
equation (2) multiplied by алм: 


03,2, F 03575 4- 0332 F 034,34, — 4ҙ 
— 3121 — 03101575 — 03101373 — 03191474 == — 031015 
(ag --- 31012) 73-| (ала — 231019) Ta A- (азд — 31034) T47 аа 031018" 


Designating аҙ — Andy. = ау), аза — Ambra = as,’ and 
so on, we rewrite the resulting equation in the form 


(1) (D а) e 
4322 + 033 X3 + G34 Ty = аз 


(3) From the fourth equation of system (1) we subtract 
equation (2) multiplied by a,,. Using similar designations, 
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we get the following equation: 
1 1 1 1 
di) Ty + 2 Ут; T арт, — = аф. 


As a result of these elementary transformations, we have 
а system of three equations in three unknowns 


айт + adl) zs а=, ah), 
asp, + ash 2s - aln, a, (1) 


(D (0) T 
aiT t a4 Ta -- ad r4, = ар, 


where the coefficients а;; (i, j >> 2) can be found (rom 
the formula а4} = aij — 110) (say, aj? = azy — аз). 

Dividing then the coefficients of ra first equation of 
system (1') by the pivot coefficient а) + 0, we get the 
first equation of the system in the form 


аў 1) 


( 
-- 56 
ner 3 + щрт = а) 


We designate 


DO D OD) D (OL | 

aj = BY, а 0, айна ИВ 
and, іп general, a3) /а() = 15) (J > 2). Then the first 
equation of system (1' ) assumes the form 


2 1 д, 
х, Fs + 0a, — Му, (2) 
or 


2, = DY} — a, — Mis, 

Eliminating now z, from all equations of system (17), 
except for the first, in the same way as we eliminated z,, 
we arrive at the following system of two equations in 
two unknowns: 


(on + а%т, = а%, (1°) 
ат, Бафт, = а, 

where aj? = ау — aj? bY) (i, јр 3). (For example, 
аз = ayy — аж 00.) Dividing the coefficients of the 
first. equation of system (1") by the pivot cocfficient 
a® 0, we get 


т + bI. = р‘) (2^) 


35? 
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where 5$? = a$j/a?? (j > 3), i.e. 


— 7,62) ar 
2 = by — b 


Eliminating now 2, similarly 1 from system (1"), we 
find that 
(3) (3) 


87, = 045, (1") 
where af? = af? — ibd i, j z 4). Пепсе 
- “ak. (2”) 


The other unknowns of the system can be found in succes- 
sion from equations (2^), (27) and (2): 

T= D — OEA 

Тус $9 — os, — ыу Тҙ, 

s = bya ату — hats — hats 


Thus the Gaussian elimination reduces to constructing 
an equivalent system of equations (2), (2'), (27), (2"). 
The Gaussian elimination can be used when all the pivot. 
coefficients are different from zero. 

For the sake of convenience, we carry out the caleu- 
lations according to a scheme of unique division. The cal- 
culation of the elements 5j; is a forward substitution and 
the calculation of the values of the unknowns is a back 
substitution since we first delermine the value of the last 
unknown. 

The scheme for the unique division (Gauss' scheme) 
is composed as follows. 

Section I of the scheme (see Table 3.3) includes the 
coefficients of the unknowns (in the columns of the cor- 
responding unknowns), constant terms and, for each 
row, "control sums" (column У),), equal to the sum of the 
elements a;j in that row (here i = 1,2, 3, 4, j = 1, 2, 3, 
4, 5); the last row of Section 1 consisting of 1 and the 
elements b,; results from the division of the first row of 
that section by the pivot coefficient a,,. 

The elements of Section II of the scheme are equal to 
the corresponding elements of Section ] minus the product 
абу (i, J > 2); for instance а = a, — а,б. The 
last row of Section II consisting of 1 and the elements 
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Table 3.3 
Sections 
д Ze of the 
scheme 
аза — 031 + 212-413 014 t 015 
426 = 031 -|- 33 + зз F 124 -F dos 
аза 031 + @з2- 833 аза -F G35 
46 = 441-042 1- Gag tag teas | ү 
bie big == 1-{-Bya-t biatb tb 
bl 1877 1 -1- Буа bia 4-514 tbis 
11 
aff) == aze — арба asp = ap - |- a3 tata -І-ау) 
abs, = Gss — 00а ар = aip -Faty -- apd- ач) 
аб =ru Que aii! — att) -| ad? + ai) ṣ- аб = 
I1|3 
3 
= 
+ 
(1) a 
| pup. Se | BY — AE b49 4- DSP 4- BSD A 
26 7 gt) a 
92 2 
ш 
a 
? 
a = al — at btt a) — at? + а а) Б 
agp — а) — a,b ay — af? 4- а +- ag? 
III 
ay 
big = Sat Mp — 1+ by +p 
а 
8 
Шеаф-афыр aly = a + aff 
IV 
pid) a= 249 bi = 1-+ 653) 
46 — 4a 87 5 
44 | 
1 
т т 5 
г -- -l 
т,= by r= 4-7, 5 
Za = by) — b T, zy 1-73 z 
— — -— — H т 
ту dg) — bz, — bd zs T2= 1422 Y Е 
21 = 616—612, гі--1--2і ж 
- — a 
— bista — блага m 
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be; results from the division of the first row of that 
section by the pivot coefficient aj. 

The elements of the third and fourth sections of the 
scheme are calculated in a similar way. Sections I, II, 
III and IV, which end with the calculation of the elements 
50-9 (i = 1, 2, 3, 4, j = 2, 3, 4, 5) constitute a forward 
substitution of the calculation of wie зспеше. 

The back substitution begins with the calculation of 
the last unknown z, of the system of linear equations 
and ends with the calculation of the first unknown 21. 
In the back substitution only the rows of the forward 
Substitution are used which contain unities and the cor- 
responding elements b;; (we call these rows "marked"). 

The element b? of the last "marked" row and the 
column of constant terms yields the value of z,. Then the 
other unknowns x, z, and z, are found by subtracting 
the sum of the products of its coefficients by the corres- 
ponding values of the unknowns found before, say, 23 = 
by — bi? x, from the constant term of the “marked” row. 

"The values of the unknowns are written in succession 
in Sec. V. The unities written there allow us to find 
the corresponding coefficients for z; in the “marked” rows. 


The so-called control sums which are in the column У), 
are used to verify the calculations 


a= dieu ti == 1,2, 8, 4) and b, Ўр, -4(4-- 1,2,3, 4). 


Іп fhe column 71, of Sections i, III and IV the same 
actions are performed on the control sums in each row as 
on the other elements of that row. If there are no errors 
in calculations, the elements of the columns У), and Y, 
are equal. Thus we control the forward substitution of the 


scheme. _ 
To control the back substitution, we find т, in the 


last “marked” row of the column Y. i.e. z, = bO and 


find the other unknowns of this column zy (j = 3, 2, 1) 
in the same rows and from the same formulas as the 
unknowns ту, with the only difference that we substitute 


the appropriate т) into the formulas. In the result, the 
numbers z; must coincide with the numbers т; + 1 
the column У),. 
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х1 | ха 





1 


| i 
[2]| 2 -4 
4 3 -4 
8 5 -3 
3 3 —2 
1 | 1 | —0.5 
а 4 
Za 1 
0| -0.5 
| 1 | -4 
[-2] 
—UÜ. 
NK 
1 
1 


x4 


0.5 


NEN = 


0 
0 








—2 


-4 
а 


Тус —1 
тз= —1 
ту= 1 
z= 1 





Xi 


14 
12 


-2 


9 


0 
0 


Za 


А 0.5 
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Table 3.4 


Sections 
of the 
scheme 


Example 1. Uso the scheme of unique division to solve the 
following system: 


21|--22,- zy + z4 = 4, 
4z,+32,— 1; J-2z4— 6, 
82, + 5z, —3z3 + 42, = 12, 
9z, 1-97, — 22, + 22, = 6. 
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A In section I of Table 3.4 we write the matrix of the system, 
its constant terms and control sums. Then we calculate the "marked" 
row of this section dividing its first row by ауу — 2, fer instance 
bia = aj Ja, = 2/2 = 1. 

The elements of Section II are calculated according to the 
following rule: every element of this section is equal to the corre- 
sponding element of Section I minus tho product of the first element 
of its row by the element of the “marked” row in its column. We 
write the result in the respective place in Section II. For example, 


55) = üz — 51515 = -——1— 4(— 0.5) = 1, 
44) = ass — ag1b44— — 3—8 (— 0.5) — 1. 
Wo obtain theclements of the "marked "row of section II by divid- 
ing its first row by the pivot coefficient aj? = —-1, for instance, 
bip = а/а —1/ (—1) = — 4. 


By analogy we calculate the elements of sections III and IV, 
for example, 
260 = al — abi = 2 —3.0.5=0.5, 
a = aq? — аЬ R = (V- (0.5) (— 1) == -— 0.5, 


To calculate the elements of section V, i.e. to find the unknowns, 
we use the “marked” rows, beginning with the last row. 

The unknown z, is a constant term of the last “marked” row: 
т = Ы = 1, and the other unknowns z,, z, and т, result from 
the successive subtraction, from the constant terms of tho “marked” 
rows, of the sums of the products of the corresponding coefficients 


iin by the yalues of the unknowns obtained before. 

The verification is done with the aid of columns 3, and Ууу. 
Tbe same actions are performed on the column Ул as on the other 
columns (see Tables 3.3 and 3.4) and, as a result, the sum of the 
elements of every row of the scheme (without the column У} 


must be equal to the element of that row from the column nm 
The numbers т} from the column У, must Бо equal to the numbers 


4--т) from the column Y. 
As а result we obtain д = 1, т, = 1, ху `= —1, z4 = —1. A 
Example 2. Using the scheme of unique division, solve the follow- 
ing system with an accuracy of 0.0001: 
0.632, + 1.002, -- 0.71425 4-0.347, = 2.08, 
1.172, 4-0.482, — 0.6523 +0.741z, = 0.17, 
2.712, —0.797,-- 1.172, — 2.357, = 1.28, 
3.582, -+ 0.282, — 3.052; — 1.182, = 0.05. 


А The solution of the system is given in Table 3.5. The final 
answer is т, = 0.4026, г; = 1.5010, т; = 0.5862, т, = —1.2678. A 
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If the approximate values of the unknowns obtained 
according to Gauss' scheme are sufficiently accurate, 
i.e. the corrections are small in absolute value, the 
refinement is not necessary. 

When it is necessary to make the approximate values 
of the unknowns more accurate, we must do the follow- 
ing: 
(1) for every equation of the system we calculate the 
errors, i.e. the differences between the right-hand and 
left-hand sides of the system resulting from the sub- 
stitution of the approximate values of the unknowns into 
the equations; if we designate the approximate values of 
the unknowns as 29, 100), ..., zy” , the errors as е), €z, 

.., £g and the constant terms as b,, bz, ..., bn, then 


п 
; (0) 
= 6,— 5 алу, 
J= 


n 
(0) 
E&:=b,— 2, Qj, 


0. 
En == br — > On ZS ^ 


v 


(2) we write the errors e; (i = 1, 2, ..., n) in a sepa- 
rate column в of Gauss’ scheme and perform the same 
actions on it as on the other columns of the scheme, 

(3) considering the column e to be a column of constant 
terms, we obtain the corrections 6; for the unknowns, 

(4) we find the precise values of Lhe unknowns adding 
the corrections 6; to the corresponding approximate 
values of the unknowns 29: 


( ) — Q0) 
I. = г” + бу, Ly = zt? -+ 6,, e.e Ly — г“ -F 6,. 


Example 3. Uso Gauss' method accurate to three decimal] places 
to solve the system 


0.492; + 1.4z, —0.822, — —1.05, 


7.002, 4-1.17z, —2.232, = — 4.75, 
| 3.212, — 4.252, 2.132, — 5.06 


Ch. 3. Solving Systems of Linear Equations 


135 


and make the approximate values of the unknowns obtained accurate 





























to 10-4 
A Using Gauss’ scheme, we calculate z(Ü, т) and z” with 
three significant digits (Table 3.6). 
Table 3.6 
aja | s [oma [oa |. 
7.09 | 1.47 —2.23 -4.75 1.28 0.00097 
И 1.4 --0.62 ті 05 0.16 0.00087 
‚21 | —4.25 2.43 6.15 —0.00295 
“| 0.1650] —0. 3145 ^ —0.6700 | 0.4805 | 0.00044 
.3290 | —0.4847 — 0.7619 0.0824 0.00084 
A TTAR 3.1395 7.2107 5.5706 | —0.00340 
E | —0.3647 | —0.5733 | 0.0620 0.00061 
| | 1. 3964 | | 4.4705 | 5.8669 | --0.00048 
---- ЕШ | 3.2045 | 4.2015 | — 0.00035 
3.2015 4.2315 --0.00035 
0.5943 | 1.5943 | —0.00048 
1 0.2388 1.2388 | -0. 105 


Thus z(9?-—0.239, 20 —0.594, z = 3.202. 


6, 
To find the correction a | we must solve the given 
6 
system with tho same matrix 
7.09 1.17 —2.23^ 
= 10.43 1.4 —0.62 
3.24 —4.25 2.13, 


and new constant terms e; (errors) which we shall calculate as 
follows. 
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1. We calculate the errors, for which purpose we substituto the 
values of z(9, 0, x) into the equations of the system: 
7.09.0.239 + 1.17.0.594 — 2.23.3.202 = —4.75097, 
0.430.239 + 1.4.0.594 — 0.62.3.202 = —1.05087, 
3.21.0.239 — 4.25.0.594 — 2.13-3.202 = 5.06295. 


The errors are equal, respectively, to 
e, = —4.75 — (—4.75097) — 0.00097, 
£g = —1.05 — (—1.05087) = 0.00087, 
5.06 — 5.06295 = —0.00295. 


| 


Ез 


2. To solve the given system, we use Gauss' scheme with con- 
slant terms e, = 0.00097, е, = 0.00087, €, = -—0.00295. Corres- 
pondingly, with an accuracy of 10-5, we get the values of the cor- 
rections 8, = —0.0004, 6, = 0.0005, 8, = —0.0001. Then we 
make the unknowns more precise: 


z, = 2 4 6, = 0.239 — 0.0004 = 0.2386; 
„£ = 1) -|- 6, = 0,594 4-0 .0005 = 0.5945; 
Zy == zl? + §,= 3.202 — 0.0001 = 3.2019. A 


3.8. Calculating Determinants by 
the Gauss Elimination Method 


Gaussian elimination can be used Lo calculate the 
determinants: 


411 8619 Gin 


ау 4) Q - 
по м еп - ауада ... aS, D 


Uni anz nn 


where ai а„, а, ..., ач? are the pivot elements 


of the scheme of the unique division. 


Example 1. Using the scheme of unique division, calculate the 
determinant 


44 2 3 
3-4-1-2 
d—|9 3 4 |. 
1 2 3-4 


A The solution is given in Table 3.7. 
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Table 8.7 
Columns 
21 Ха 
1 | 2 | 3 | 4 
[1] 5 a 2 | 3 7 
3 |-1 -4 -i -4 
2 3 -4 -4 3 
1 2 3 -1 5 
(|а| «| э |: ot fot 7 
| —4| --7 -1 -22 -22 
1 -5 -1 —11 --44 
1 1 -4 -2 -2 
i 
| | 7/4 | 11/4 | 22/4 | 22/4 
[-27/4] --39/4 — 06/4 — 66/4 
—3/4 -27/4 —30/4 — 30/4 
| | 1 | 13/9 | 22/9 n | ав 22/9 
| | | [—17/3 | —17/3 Em | -пз | n —17/3 





Thus d = 1-(—4)-( -27/4)-(—17/3) = —153. A 
Example 2. Using the scheme of unique division, calculate the 
determinant 


1.00 0.42 0.54 0.66 | 
0.42 1.00 0.32 0.44 
0.54 0.32 4.00 0.22 
0.66 0.44 0.22 1.00 


das 


with an accuracy of 0.001. 
A The solution is given in Tablo 3.8. 
The final result is 4 = 1-0.8236-0.6978-0.4979 = 0.286. A 
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Table 8.8 
Columns 
21 Is 
(| «| а fe 
[1] 0.42 0.54 0.66 2.62 
0.42 1.00 0.32 0.44 2.18 
0.54 0.32 1.00 0.22 2.08 
0.661 0.44 0.22 4.00 2.32 
| 
1 | 0.42 | 0.54 | 0.66 | 2.02 | 
[0.8236 | 0.0932 0.1628 | 1.0796 | 1.0796 
0.0932 0.7084 0.4364 | 0.6652 | 0.6652 
0.1628 — 0.1364 0.5644 | 0.5908 | 0.5908 
| 1 | 0.1135 | 0.1973 | 1.3108 | 1.3108 
[0.6978] | -0.1548 | 0.5430 | 0.5430 
—0.1549 0.5323 | 0.3774 | 9.3774 
| | 1 | —0.2219 | 0.7782 | 0.7781 
| | | [0.4979 | 0.4979 | 0.4979 





3.9. The Gaussian Elimination for Inversion 
of a Matrix 


Consider a nonsingular matrix A = [а;;] (i, j = 
1, 2,..., n). To find its inverse A-! = [z;,], we use the 
fundamental relation AA-! = J, where J is an nth-order 
identity matrix. 

Thus, for a fourth-order matrix, performing the multi- 
plication 


ауу 412 413 034 Тур 21; Tig 214 10007 
АА-1— — 9 022 Gan Q24 | | 721 722 Тоз Toa |... 0100 

431 032 235 4% їз] Із, T33 T34 0010 

441 043 44; 444 Ty Tag 245,244. 10001- 


Ch. 3, Solving Systems of Linear Equations 139 
we get four systems of equations for 16 unknowns 24) 
(i, j = 1, 2, 3, 4). 

In the general case, we have relations 


n 
2, Aine Еһ) 6, (i, ј == 41, 2, „++ п), 


where 
1 for i=j, 
бу = 0 for ij, 


6; is the Kronecker delta. 

Then z systems of linear equations obtained for 
]1,2,...,n have the same matrix A and different 
constant terms which constitute an identity matrix, and 
therefore we can use Gaussian elimination method to 
sulve these systems. 

The solutions т;; found according to the scheme of 
unique division are the elements of the inverse matrix 
A. 


Example 1. Use Gauss’ method to invert the matrix 


10 
—12 
A=: 


0 2 


12 
31 


20-21 


12 


А The solution is given in Table 3.9. 
Thus 


0 1/3 

—1/2 1/6 
1/5 — 7/5 
2/5 —2/5 


1/3 —1/3 

1/6 1/3 

1/15 —7/15 
--1/5 2/5 


Ah 


Example 2. Invert the matrix 


1.00 0.47 
0.42 {л 
—9.25 0.67 


0.54 —0.32 


— 0.11 0.55 
0.35 0.17 
1.09 0.36 

— 0.74 1.00. 


A= 


using Gaussian elimination method. All the calculations must be 
done to four decimal places. Round off the &nswer to three decimal 
places. 

А The solution is given in Table 3,10, 
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Table 3.9 
51) |5а)| Әз) | “ap |Get | j=2 | j=83 |j=4 | 54 Ха 
i] | 0 1 2 1 0| o | 0 5 
—4 2 3 1 0 1 0 0 0 
4 0 —2 1 0 9 1 0 4 
0) 2 1 2 0 0 9 1 6 
(|| a] 2] а] of of o ] 515 
2 4 3 4 1 0 0 11 11 
o| -6 | —-7 | —4 0 1 о |—46 | —16 
2 1 2 0 0 0 1 6 6 
| 1 | 2 | 3/2 | 1/9 | 1/2 | ü | ü Ер | 11/2 
[=6|| -7 | -4 | 9 1 ü | | -16 
3|-1|-11-1 0 1 -—5| —5 
| | 
| 
| | 4 | 7/6 | 4/6 | T ШІ 0 | 46/0 | 10/6 
ШЕСІШЕЕСЕНШЕ 
| | | 1 | 2/5 |-аһ| -15| 2/5 | 6/5 | 6/5 
1 2/5 |—2/5 |—1/5 | 2/5 | 0/5 | 6/5 
1 4/5) 7/45] 1/15| — 7/15| 19/15 | 19/45 
1 —1/2| 1/6 | 1/6| 4/3 | 7/6 | 7/6 
1 0 1/3 | 1/3 |-1/3 | 4/3 | 4/3 
Consequently, 


4.9759 —1.2047 — 0.0120. —0.8781 
да| 712883 2.1003 —u.4869 0.5268 
=} 4.4921 —1.7239 1.0873 — 0.94189 
—0.3750 0.0453 0.0553 0.9626 
4.976 — 1.209 —0.042 — 0.878 
—1.288 2.100 —0.487 0.527 
^| 4.492 —1.724 1.087 —0.919 |: А 
—0.375 0.045 0,655 0.963 


Xij 


| 1.00] 
0.42 
—0.25 
0.54 


і-2 


ü 


ü 
0 
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Table 8.10 
| 
| х2) *3J 
0.47 — 0.44 0.55 
4.00 0.35 0.17 
0.67 1.00 0.36 
—0.32 —0.74 4.00 
| 0.47 | -0.11 | 0.55 | 1 
р. 8026 | 0.3962 |—0.0610 — 0.4200 
0.7875 0.9725 0,4975 0.2500 
—0.5738 —0.6806 0.1080 — 0.5400 
| 
| 1 | 0.4930 ЕШ. | --0.5233 
[9.5838 | | 0.5573 0.0621 
— (1.3974 0.6594 —0.8403 
| | 1 | (9.9546 | 1.1341 
| | | 1 sss] —0.3896 
| | Б 1 | —0.3750 
z,i— — 0.3150 
1 za — 1.4921 
1 I91— —1. 2883 
T11— 1. 9759 
| 1-3 | j= Zi | Ys 
0 0 2.91 
0 0 2.94 
1 а 2.78 
0 1 4.48 
0 0 | 2.91 | 2.91 
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Table 3.10 continued 














|, | і-% Zi Z3 
0 0 1.7178] 1.7178 
1 0 3.5075| 3.5075 
0 1 —().0914)—0.0944 
мю | 0 | 0 | 2 ша 2.1403 
--0.9812 1 0 1.822) 1.822) 
0.7150 0 1 1.1367| 1.1367 
4. 6807 | 1.7129 | 0 | 3.1209) 3.1209 
0.0471 | 0.6807 | 1 | 2.370 2.3770 
0.0458 | 0.6553 | 0.9626 | 2280 2.2882 
Z= 0.0453) 1ҙ-: 0.6553 т,,-- (1.9626| 2.28821 2.2882 
Zg = — 1.7239 | тҙас-- 1.0873) =з. = — 0.0189| 0.9366] 0.9366 
Z49— 2.1003) 7,,— — 0.4869 | т,,-- 0.5268] 1.8519] 1.8519 
Zyg== — 1.2017 | z,4— — 0.0120 | z,,— — 0.8781] 0.8841| 0.8841 


3.10. Cholesky's Method 


Assume that a system of linear equations is given in 
the matrix form 


Ах — b, (1) 
where A=[a,;] is a square matrix of order n, and 
тү “ата” 
х= - and b— M are column vectors. 
Zn —@п,п+1— 


We represent the matrix А as the product of the lower 
triangular matrix С = [c;j] and the upper triangular 
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matrix В = [b;;] with a unit diagonal, і.е. 


А - CB, 
where 
сүү 9 0 ee 0 1 bj 6з... буп 
сі Cog П... O 0 1 by ... den 
C=] сал «за саз ... 0) , В=|00 1... |. 
Cni na Спз ++ Cnn 00 0...1 


The elements с;; and b;; are found from formulas (17) 
and (18) of 2.6: 


3-1 
€ — ац. у= ау— È Сабы for 1j si, (9) 


i-1 





а) 413 — У Cikbhj 
b, = ен , big MS for 1<1і<2). (4) 


We can write equation (1) іп the form 

CBx — b. (5) 
The product Bx of the matrix B and the column vector x 
is a column vector which we designate as y: 

Bx = y. (6) 
Then we сап rewrite equation (5) in the form 

Су = b, (7) 


са 0 0 ‚0 yn 01, n+l 
Coy C29 0 e.0 Va 02, n+1 
€i Сад С... 0 Ys |= | аз. һы |. (7) 
Cni Спа Cng >... Cnn Vn ün, n+1 


The elements су; (i, j = 1, 2, ..., n) here аге known 
since the matrix A of system (1) is assumed to be expand- 
ed in the product of two triangular matrices C and B 
[formulas (3) and (4)!. 


or 
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Multiplying the matrices on the left-hand side of re- 
lation (77), we gel a system of equations 


Сілу = 01, n+l» 


Cay1-l- C23Y3 == 03, п+1, (8) 
€31J1 F €32J2 F СззУз = 4з, п+1› 
Cni¥1-b Cnol/s -l- €nsUs-l- «++ t+ €nnUn = @п,п+1› 


whence we oblain the [following formulas for the 
unknowns: 


i-1 
di, п >) АТТА 
41, n+1 h=1 ; 
= yipm—————————, ір 1, 
Va ue Vi eu . i> (9) 


lt is convenient to calculate the unknowns y; together 
with the elements dij. 

When all y; (i = 1, 2,..., n) are found from formulas 
(9), we substitute them into equation (6): 


1 ‚5а bis ... bin ті іл 
0 4 O ... Ban T3 Ja 
0 0 1 ... ban T3 Уз 
00 0 wed Zn уп 


Multiplying, we get a system 


21-|- 61223-|- Pisa H- .. + bina = 01, 

М Z5-|- boata -H . . . -H Venta = уз, 
Z3-|- ..- -bsnzn = уз, (10) 

Tp — уп. 


Since the coefficients b;; have been determined [see for- 
mula (4)], we can calculate Ше values of the unknowns, 
beginning with the last one, using the following for- 
mulas: 


n 
In = уһ m= y È Базы і< п. (11) 
жеі4- 


This method is known as Cholesky's method (improved 
elimination method), in which the usual control with 
the aid of sums is employed. 

When we solve systems with the use of Cholesky's 
method, it is eonvenient to use Table 3.11 and seek y, 
together with the coefficients b;. 
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Example. Using Cholesky's method, solve the system 


321— 224 — 573+ 2,— 3, 

2z; —3z4 + z4 4- 57, = — 3, 
Z,+2z, —4r,= — 3, 

Z1 — Ia — 4T + 92, = 22. 

A The solution is given in Table 3.11. 

In the first section of the table we write the matrix of the coef- 
ficients, its constant terms and control sums. 

Tien we fill in section II according to the rule indicated in 2.6, 
i.e. first find the first column of the mitrix C, then the first row 
of the matrix B, the second column of the matrix C, the second 
row of the matrix B and so on. 

Section ІП is used to determine г). 

The verification is done with the aid of the column X with which 
we perform the зате operations as with the column of constant 


terms. 
(4) We find the elements of the first column of the matrix C 


from the formula 
en =a, (i= А, 2, 3, 4). 

Then we write the first column of section I into the first column 

of section Il: 
€4 = ау = 1, Сар = 034,77 2, Cg, = азу 7 А, сар 77 dap 7 2. 

(2) We find the elements of the first row of the matrix B from 
the formula 

bij = ауу/суу G — 2, 3, 4, 5, 6), 


Бат ауу/суу == 2, big = ayg/eyy = —1, 
Буа == а/с = 2, ур = bis = ауысы = 4, bio == а/с = 8, 
baa = 1 -F bia t bis Houat yg = A 2 1 E248. 
3) We find the elements of the second column of the matrix С 
from the formula 
Cia = Qj; — спір (i — 2, 3, 4), 
i.e. 
Саз 77 azs — Caibi 3 — 2:2 = —1, 
Саз == 4) -- Садат 5 — 4:2 = —3, 
Саз == 44 — Cabia = З — 2-2 = —1. 
(4) We find the elements of the second row of the matrix В 
from the formula 


EET ITUR (j — 8, 4, 5, 6), 


^ 
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i.e. 
bon = йз — Corbis _ --1--2:(-1) ——4 
23 Coa --1 , 
54 — 651b 4-2.2 
ba, = 24 21 14-- —1) 
24 Соз --4 , 
no С» 5 1.2.4 
Ja — bag — Laner ан 0258 2 : -2, 
26 — € 4--9. 
Dog 29 021710 ur =- 4-28 2 8 т :2, 


bog = 1-|- bagt bas H- Bag — 1 —1-| 0--2— 2. 
(5) We find the elements of the third column of (he matrix 


C from the formula 
біз 77 ару — Cilia 77 сб», (i = 3, 4), 
i.c. 

Сул = чаз = farbig o 03gh33 77 3--4-(-1)--(-3)(-4) =- 2, 
Саз Ug Cabia - (аба 2-59 -2 1) — (—-1)-(--1) 21. 


(0) We find the elements of the third row of the matrix В from 
the formula 
3j-7 C31 ij 7 сәз?) (іс-4, 5, 6), 
сэз 





bag: 


азу — Сула Cagla 8-- A-2--C- 3) —ı 





ha Con — 

ta: Dag = aas — Cabin — Cabas _ 12—4:4—(—3)2 _ 
Ya == Og, == сіз = 5 

һ ‚_ ago — Cai 1577 Casos — 26 — 1.8. (—3:2 | 

в Саз С -% ' 

bag = 1- bag} bag —1-]-0--1— 1), 


(7) We find the elements of the fourth column of the matrix С 
from the formula 


баа T 04a 7o Carbia —— баба — Саздан» 


сас2- 22-(-4)0 - 4.0 = —4, 


(8) We find the elements of the fourth row of the matrix 5 
from the formula 
bap а) Cardy — сазда) — Candy (і--5, 6), 


10% 
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i.e. 
Ya= bis = 448-- биби байы Cagbs; 
44 
_ .6—2.4—(—1).2—-(—1)(—1). 1 
2-4 ! 
b.e = G4g — Сав — Eal g0 — Ca abaa 
Сда 
__ 12—2.8—(—1)2—4.0 | 


--1 -2, 


bag 1 4 bay 1-E 17:2. 
(9) Then we calculate z; using the formula 


n 
Tj — Hj — У біті, iz 1, 2, 3, 4, 
һ=1-+1 
where у= 4, У;:-2, y= --1 and у:—1. We have 
z4 — ya. = 1, 
25 = уз — byt = —1 — 0:1 = —1, 


Z4 = Ya — Өзіз — 5441, = 2 — (—-1) (—1)-- 0.1 = 1, 
жу = уу — буту — бі; — bur, = 4 — 2-1 — (—1) (--1) 
— 2:1 = —1. 
Thus 
a= —14, хр = 1, 1, --і, % -L Д 


3.11. The Iterative Method (the Method of Successive 
Approximations) 


The approximate methods for solving systems of linear 
equations make it possible to obtain the values of the 
roofs of the system with the specilied acenracy as the 
limit of the sequence of some vectors. The process of 
constructing such a sequence is known as the iteratire 
process. 

The efficiency of the application of approximate meth- 
ods depends on the choice of the initial уссіог and the 
rale of convergence of the process. 

In this section we consider the method of iteration 
(the method of successive approximations). Assume (hat 
we are giyen п linear equations in n unknowns: 

t1121 + liata -...--біл2 = Oy, 
аҙ121--4%%1а--...--бепіп = 02, (1) 


Gn171 tanza t ...-- 4nnZn bn. 
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We write system (1) in matrix form: 
Ax — b, (3) 


wliere 
414 32. ee Gin ғ 5, 


аз flag... Azn Ta bs 


ДЕЕ QX—| e. |,Ь-|. 
Uni anz +++ Onn Th. bn 


Assuming that the diagonal elements a,, == 0 (, = 
1, 2... ., п), we express x, using Lhe first equation of the 


system, 2, using bhe second equation and so on. As a 
result we gel a system equivalent to. system (1): 














hi ау; а а 
х= Іші Өз т — -42 тз—...-- іп 21, 
а а 
011 ап 1 11 
b а fla а; 
т Ё. шур —2%®г,—...-- UP | 
423 Go» flog а (3) 
b а Ang а - 
ep LIRE pile DE ee ete, 
n 1 2 п-1 
ап, (пп lnn ünn 


We designate 5,/a,; = Bio ора -= ор where 4 = 
[,2,... n f= 1,2,..., n. Then we can write system 
(3) as follows: 

zy i Bick iata d 0a d e eias 
3 — В, -1- Aarti | Agata eor банан, o 
(3) 


£i — Ва Oni) | €nsta d- +++ On, п—ү®ң. 


System (3) is known as а system reduced to the normal 
form. Introducing (һе designations 


011 Ayn «++ Ain в, 
Оз) Ogg ..- Syn В. 
a - , В = : , 


_ Фп Ол»... X€nn Pn 
we write system (39 in matrix forne 


х= ох, 
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тү By ат 6... Ay 521 
та В; Gat Qs +++ On тұ 
=: |+ | 0 


or 


Zn Ba Өлі Anz ++: Ann In 
We use the method of successive approximations Lo 
solve system (4). For the zerolh approximation we take 
the column of constant terms: 
20 В: 
т” 2 
=|. is the zeroth approximation. 


zi” Bn 


Then we construct а column matrix 


7p) г” T „(ш 
Ti В. 914 Qiz e бал Ti 
(D w f is rs 
E В; Өзі бо +++ Gon Ty із the first 
. ==}. + approxima- 
: : tion, 
rp Ва Өңі Anz -> Onn [E (0 
[^ 40D (1) 
ті В. 011 а)... Gin Ti 
т? В, Од Aggy ss Ayn 259 [| is the second 
. -. l- . approxima- 
ріс u : tion, 
eg Ba Oni Ола, Gan FL 


and so on. 
In general, any (A + 1)th approximation can be cal- 
culaled by the formula 


x+) — В - axl) (k 0, 1, ..., n). (5) 

If the sequence of approximation x, x® ,..., x has 

a limit x = Jim x, then this limit is a solution of 
h->oo 


system (3) since, by virtue of the property of the limit 
lim x^*D = B ta lim x, i.e. x = а 4- Bx. 
хо hoo 
Example 1. Solve the system 
871+ z4 1-24 = 26, 
| z;4-5z,— 74 — 7, 

z,— 244-524: 7 

with an accuracy of 10-! using the iterative method. 
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^ (1) We reduce tho system to normal form 
Тіз-3.25--0. 25z,—0.125z,, 
{ --1.4--0.221-|-0.2г;, 
і-<1.4--0,2г1-Һ0.22;; 
0 —0.125 —0.125 
a=| —0.3 0 0.2 | 


—0.2 0. 


(2) Wo construct successive approximations. The zeroth арргох- 
imation is 








z -3.25- 
[9 = 1.4 |, 
250). 1.4 . 


The first approximation is 














roth 3.25 е —0,125 —u.125 - 
х0) а |+ -—wu.2 wu о.о | 
т}. 1.4 d | —0.2 9.2 T 

8.25: 2.9 - 

1.4 B 1.03 | . 

1.4 1.031 


‘The second approximation is 


uq 3.25 | 00 - 9,25 . 0.125] 42.9 |2992 
Ж ate | —0.2 0 0.2 1.03 | -= б 
тү? 1.4 —w2 03 a 1.03 | 5 026. 

















The third approximation is 





ге 3.25 Ho --0,[25 —-0.125| 62.992 2.99 
гуз |. | 1.4 | | --0.2 e 0.2 | 1.026 | — | 1.01 
тї”. 1.4 —0.2 0.2 0 1.026. 1.01. 





Thus 2, = 2.99, ra = 1.01, 23: 1.01, and. with an accuracy 
of 1071, we obtain тұс: 3.0, za = 1.0, z=- 1.0. A 
Example 2. Solve "ihe system 


т.б | 0.5, 
| 2.22,-| ®.1т„- 


- 


-Ata 9.7, (*) 


- 4.325, 1 O.22,-| 5.824 — 1.4. 


lI 


4 2.474 221.9, 
[- 
-l 


with an accuracy of 10-3 using the iterative method. 
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A (1) Wo reduce the system to normal form: 


aya 19 05, 24, 
1734.6 7.6? 7.6" 
,-Ө7 22, 44, 
? 9.4 094757947" 

—1.4 0.2 


1.3 
t= — 8 «5.87! — 5.8 7" 


T,= 1.0659 — 0.24182, —0.48477,, 


2, —0.25— 0.0652, — 0.315824, 
or 
Ty= —0.2414-]-0.22412, —0 .3448z,; 


0 — 0.065  —0.3158 5 0.25 
= | -^.2us 0 — (0.4847 | А p= | сем 
L 0.2244 —0.3448 0 - — 1.2414 


Note that we can also do the following to reduce a linear system 
to normal form: wo write the coefficients of z,, Zp, =з in the corre- 
sponding equations of system (*) in the form kz. where k is a number 
close to the coefficient of the respective unknown and by which it 
is easy to divide the coefficients of the uuknowns and constant terms. 

For example, 


10z, = 7.6z, -|- 2.4ғ, (in the first equation), 
10z, = 9.1z, + 0.9z, (in the second equation), 
10z, = 5.82, ---4.2z3 (in the third equation). 


We rewrite system (*) as follows: 


10r, — 9.7 — 2.2z414- 0.92, — 4.423, 
102,-- — 1.4 + 1.32, —0.22z,4 4- 4.Zra, 


l ті--0.19--0.24г,-0.05г,-0.241;, 


| 102|--1.9--:2.41-0.5г,-2.4г), 


Za = 0.97--0.2271-Һ0.09г,-0.44т;, 
та= —0.144-0.1324 — 0.022, 4-0 4225. 


The matrix « and the vector B assume the form 


0.24 --0.05 —0.24 - (0.19 
г — 0.22 0.09 — 0.22 | , s=] 0.07 
0.43 —0.02 0.42 . —0.14 1 


(2) We find in succession that 


2\90) 0.19 
| 097 |. 
240 — 0.14 
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ға - (0.194 qr 0.24 —0.05 —0.24 - 0.49 
Ex os |+| -аш 9.09 -va |х| іл | 


240) —0.14 0.13 --0.02 0.42 —0.14 
0.2207 
== | 1.0774 | . 
--(!.1935 
202). 0.19 - 0.24 —0.05 —0.24 - - 0,2207 
[=e |-| os | + —0.22 0,09 —0.44 Ы ram 
xf?) --0.14 0.43 -0.02 0,42 — 0.1935 
- 0.2350 
«| tnos | . 
. —0.2144 
Thus, with an accuracy of 10-3, we obtain 
ті = 0.236, т, — 1.103, г) = — 0.214. А 


3.12. The ^^nditions for Convergence of an Iterative 
Process 


Consider a system of lincar equations reduced to nor- 
mal form: x = В -b ae. The condition for convergence 
of an iterative process consists in the following: 4) the 
sum of the moduli of the elements of the rows or the sum of 
the moduli of the elements of the columns, is smaller than 
unity, then the iterative process for the given system reduces to 
a unique solution irrespective of the choice of the initial vector. 

Consequently, we can write the condilion for conver- 
gence as follows: 

n 
Y dou <1 (4-1, 2, ...,") or 


ігі 
Х16<<1(/.-1,2,..., n). 
інгі 


Example. l'or the system 
Вгу-| 7,-]- 75 =: 26, тізе3.25--40,125г,- 0.12524. 
1 z,-| 5,— 254-7, or { Ta = 14-022, — - 02a, 
Tı —2,4-52,=-7, Ty 14.4— 0.22;  -| 0.223, 


ihe iteration process converges since 


u 0.125 —%.1754 
a= БЕ 0 0.2 
—0,2 0.2 0 J 
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aud 
[O11 E | aa | E 1931 | 50.2-E0.2—0.4 <1; 
| æsa 1-Е аа 1 H- | | —0.1254-0.2—0.325 < 1; 
| ais 1-1-1 Gas 1 1 Gg | —0.125-[-0.2— 0.325 < 1. 

By analogy, wo can verify the fulfillment of the condition for 
convergence laking the sums of the moduli of the clements of the 
rows, 

The iterative process obviously converges if tho сІетепів of tho 
matrix æ satisfy the inequality | су | < 1/л, where nis tho number 
of the unknowns of the system. In this oxamplo n = 3 and all the 
elements | 2; | < 1/3. 


The convergence of an iterative process is related. to 
the norms of the malrix œ as follows. If one of the condi- 
tions 


n 
llall, — шах Ж [®;;| «1 
i іс 


or 
ЕДА 
lall — max >; layl<1, 
2 i=l 
or 
т n 
а= V Ж M leui te 


is fulfilled, then the process of iteration of the linear system 
converges to а unique solulion. 


Thus, in the example considered above, the norm 
|| ell; = max (0.4, 0.325, 0.325) = 0.4 < 1, 
i.e. the iterative process converges. 


3.13. Estimation of the Error of the Approximate 
Process of the [terative Method 


If the permissible error є of calculations is specilied 
and х; is the vector of the exact values of the unknowns 
of a іп аг system and x? is the &th approximation of 
the values of the unknowns calculated with the use of 


the iterative method, then, to estimate the error 
l| x; — xf? || < е of the method, use is made of the 
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formula 


RENT lant 
\х;—х®<с-[®=-. 1р1, (1) 


where || @ || is one of the three norms of the matrix о, 
I| B || is the same norm of the vector В and & is the number 
of iterations needed to altain the specified accuracy. іп 
this case we assume that the successive approximations 
x (where у = 0, 1,..., k, é=1, 2, .. ., n) are cal- 
culaled exactly, without the round-off errors. 


Example. Show that for the system 
9.9z, — 1.52,-|- 2.624, — U, 
0.4z, -}- 13.62, — 4.224: - 8.2, 
0.72, -- 0. Az, -- 7.125 2 — 1.3 
the iterative process converges and find out how many iterations 


inust be caro ont to find the unknowns with an accuracy of 10-1, 
A (1) We reduce the system to normal form 


1üz, — 0.12, 4- 1.529 — 2.674, 
Wr, :- —U. Az, -|-6.40,-- 4.22, 8.3, 
10z4 zs —U. 7.4, —0.475-]- 2.924 — 1.3, 


or 


түсе 09.02, 4- 0.322, 10.215 3- 0.41, 


| z, 0.012, -|- 0.197, — 0.2623, 
21-- —U O7, —0,04z, -- 0.2074 — 0.13. 


(2) The system matrix 


- O04 0.15 — 0,20 
«=| —0.02 0.392 0,21 | . 
— 0.07 — 0.04 (+.29 
Using the norm || ® ||, we get || a ||; = шах (0.1, 0.51, 0.76) - = 


0.76 < 1. Consequently, for this system the iteralive process con- 
verges. 


0 
(3) We have =| 0.44 |. Il B lg —-0-1-0.41 H0413. 9.54. 
—1.13 - 
(4) Using formula (1), we find that 
ijo IS T. ls — 0.76R+1.0.54 
i--]als  —— —* 46 

10-4- 46 
a 


Іх-х || < < n^, 


9.76851.0,54 g 1074.0 .46; 0, 76441 «с 
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(k-|- 1) log 0.76 < log 46— log 54— 4, 
— (k-|- 1)-0.1192 < 1.6628 — 1.7324 — 2 = — 4.01696, 


4.0696 — ., Е 
k+1> 7719522 32:9 k > 32.9, k—33. 


Tho theoretical estimate of the nuinber of iterations necessary to 
ensure the specified accuracy proves to be too high in practice. A 


3.14. Seidel's Method. The Conditions for Convergence 
of Seidel's Process 


Seidel's method is a modilication of the method of 
successive approximations. When calculating Шо 
(k -+ 1)th approximation of the unknown т; (i > 1) by 
Seidel's method, we must take into account the А approx- 
imalions of the unknowns тү, £o, . . ., z; 4 found before. 

Consider a linear system reduced Lo normal form 


тү== Bi- € 1121 HF Atat el Cintas 

Ta = Ba -F Aziti -FH Aata H - - --l- ann; 

Ty = Вз -|- 93121 A- &a374-l- . . - -l- ann, (1) 
£y 2 Ba] ®лүтү-|-®ңәл„-{-...-|-Жап©®л. 


We arbitrarily choose the initial approximations of tlie 
unknowns тү”, 209)... х and substitule them into 
the first eqfiation of system (1): 


(0) 


(0) І ] 
d uo quu. 


4) 
дү? == pda nnd uus 


1 


We substitute the first approximation гү” into Ше second 


equation of system (1): 


(D. а» pO) (0) 
159 = By gg Ty? d GP ss] Xue 


IE 


Then we substitute the frst approximations гү” and 


г? into the third equation of system (1): 
TP В, -t Gary? Esai -aaa заи 
and so on. Finally we have 


a аэ OH UD 
zQ- Pn -1- 9.12; “| Wy aX, + ed On п-т 1 | Опи 


By analogy we construct the second, the third, cle. 
iterations, 
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‘Thus, assuming that the Ath approximations 2! are 
known, we use Seidel's method to construct the (с + 1)th 
approximations by the following formulas: 


(A41 À 
Ti . ee |J 5 ут. x, 


tht 
d: t Be | a D + > aja, 
-2 (2) 
gp rn ESO n 
tl n k 
= Pr: B 2 аһ ) |р апп), 


where k—0, 1, 2, 


Example 1. Use Scidel's method to solve the system 
7.627, -|-0.5z$ |- 2.424 — 1.9, 
2.2r,-| 9.175-]- 4.475 —:9.7, 
—:4.32,-]-0.22,-]- 5.874 = — 1.4 
wilh an accuracy of 10-3, 
А (1) We reduce the system to normal form: 
10921-- — 1.0-- 2.47, — 0.524 — 2. Ara, 
107,:-  9.7—2.2r, |- 0. fr, — A. Az, 
dra — -1.44-1.3г1- 0.275 | 4.209, 
or 


Ta-= 0.97 — 0.222, |- 0 92, — 0 Ara, 


l ту 0,194-0.24|-0.05т, -0.2474, 
ла — 0.44 4- 0.130, — 0.02 r4 |1,42; 


(2) For the zeroth approximations we take the corresponding 
values of constant terms: z( = 0.19, 2D = 0.97, z = —0.14. 

(3) We construct iterations using Seidel's method. The first 
approximations are 
т0) = 0.19 -|- 0.24.0.19 — 0.05.0.97 — 0.24. (—0.14) = 0.2207, 
zp) = 0.97 — 0.22.0.2207 + 0.09-0.97 -- 0.44. (—0.14) = 1.0703, 
z(t) — —0.14 + 0.13.0.2207 — 0.02.1.0703 -|- 0.42.(--0.14) 

= —0.1915. 

The second approximations are 
тФ) = 0,19 |- 0.24-0.2207 — 0.05.1.0703 — 7,24:(—0.1915) 

-= 0.2354, 

20) -= 0.97 — 0,22-0,2354 + 0.09-1.0703 — 0.44-(—0.1915) 
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— 1.0988, 

148) = —0.14 + 0,13.0,2354 — 0.02-1.0988 + 0.42-(—0.1915) 
= —0.2118 

and so on. 


The solution of this example is given in Table 3.12. The con- 
struction of iterations is completed when we get the same values 
‘in two successive iterations with the specified degree of accuracy. 
In this example these are iterations 7 and 8. 

The final answer is т, = 0.248, т == 1.114, r4 = —0.224. A 


Table 3.12 
8 8 
$3 X, хо X3 53 ХІ Ха Xa 
ovo oc 
zx An 
0 | 0.19 0.97 —0.14 5 | 0.2467| 1.1138 | —0.2237 
1 | 0.2207) 1.0703 | —0.1915| 6 | 0.2472| 1.1143 | -0.2241 
2 | 0.2354} 1.0988 | —0.2118 7 | 0.2474| 1.1145 | —0.2243 
3 | 0.2424 |. 1.1088 | —0.2196| 8 | 0.2475 1.1145 | --1.2243 


4 | 0.2454| 1.1124 | —0.2226 


For the linear system x = В | az Seidel's process 
(as well as the process of successive approximations) 
converges to a unique solution for any choice of the initial 
approximation if at least one of the norms of the matrix a is 
smaller than’ unity, i.e. if 


т 
Па |, = max 2 [ayl «m1 
а j= 


or 
a 
||. = max ы lal « 1, 
4 it 
or 


—— 
9 
leli- y 16131. 
4,2 
Seidel'& process converges to a unique solution faster 
than the process of a simple iteration. 


Example 2. Verify whether Seidel's process converges for the 
system considered in Example 1. 
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А (1) After reducing the system to normal form (see р. 157), 
we get a matrix 


- 0.24 —0.05 —0.24 
a= | –02 0.09 1и | . 
0,13 —0.02 0.42 


(2) We find that || а ll = max 2 [æj | — max (0.53, 0,75, 0.57) — 


0.75 « 1. Consequently, for this “system the iteration process con- 
verges to a unique solution despite the fact that || a ||, = 


max y | ау | == max (0.59, 0.16, 1.1) — 1.12» 1. А 


il 


3.15. Estimation oí the Errors of Seidel's Process 


Consider a linear system x = [ +4: ох. If x; is the exact 
value of the unknowns of the linear system and x™ is 
the Ath approsimation calculated by Seidel’s method, 
then, to calculate the error of this method, use is made 
of the formula 


h hh iS" : - 
IIx — x0 ТЕТЕ [| x9 — х9 |. (1) 


Example. Find how many iterations Seidel's method requires 
to find a solution of the system 


9.02, —1.91,-|- 2.023 —0, 
0 .Az, -+ 13.67, — 4.274 — 8.2, 
0.72, 4- 0.42, ]- 7 175 — —-1.3, 


with an accuracy of 10-1. 
^ (1) We reduce the system to normal form (see p. 155): 


Zy= 0.41 — U L2, -|- 0.322, 40.2123, 


40.042, -|-0.1524 —0.262,, 
тут —0.13—0. 07т|--0. 042, -|- О. 29г„. 


(2) For the zeroth approximations we take the column of con- 
stant terms 29) = 0, т@) = 0.41, 7%) == —0.13 and calculate the 


first approximations: 
2) = 0,04.0-]-0.15.0.41 — 0.26. (—0.13) = 0.0953, 
z% = 0,41 —0.02.0.0953--0.32.0.41 4- 0.21. (—0.13) «0.5120, 
210 = —0.13— 0.07. 0.0953 —0.04-0.5121 4-0.29. (— 0.13) 
= —U.1948. 
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(3) The matrix 
0.04 0.15 —0.26 
Е 0.32 ала | . 
—0.07 —0.04 — 0.29. 
This means that || о ||, = max (0.42, 0.55, 0.40) = 0.55. Since 
D - 0.0953 
х0)-- 0.41 | and х0) = 0.5120 |, 
ЕЯ БЕЛ 
we have 
0.0953 
xo-am-[ sam |, i.e. || xD — x | — 0.1120, 


--().0648 
(4) We find k from formula (1): 





h 
10-4 < ra -0 4120, 10-4.0,45 «0. 55.0.4120 
— 4 log 19-|-log 0.45 < k log 0.55 + log 0.1120, 


4.3468 
1.2104 
Dy analogy we can estimate Scidel's method using the norm 


[а 112. A 


-— 4—0 .3468 < k (— 0.2596 — 02.9508), k> =3.59, k= 4. 


3.16. Reducing a System of Linear Equations to a Form 
Convenient for lterations 


For the linear system x = В + «x tho process of 
successive approximations and Seidel's process converge 
to a unique solution irrespective of the choice of the 
initial vector if 


Ті 
MN 4; «4 (i= 1, 2, ..., n) or 
j=l 


n 
д layl << 1 (і--1, 2, oy HR). 


Thus, for these iterative processes to converge, it is 
sufficient that the values of the elements о; ; of the matrix 
a, lor ij, be not very large in absolute value. This is 
equivalent to the fact that if, for the linear system Ax — 
b, the moduli of the diagonal coefficients of each equation 
of the system are larger than the sum of the moduli of 
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АП other coefficients (not counting the constant terms), 
then the iterative processes converge for this system, i.e. 


n 
if we have a system У Qj; = b; (= 1,2, ..., n), 
j=1 


with | au |> У) [ау |, then the process of successive 
jel 
approximations and Seidel's process converge for this 
system. 
Using elementary Lransformations, we can replace the 
linear system Ax = b by the equivalent system x = 
В + ох for which the conditions of convergence are 


fulfilled. 


Example. Reduce the system of linear equations 


0.92, 4- 2.724 — 3.824-- 2.4, (A) 
2.52,-|-5.8z, —0.525 — 3.5, (B) 
(4.02, — 2.11, 4- 3.224 — —1.2 (C) 


to a form convenient for iterations. 

^ a) From this system we isolate the equations with coeff- 
cients whose moduli are larger than the sum of the moduli of the 
other coefficients of the system. We write every isolated equation 
as a row of the new system so that the coefficient, which is the 
largest in absolute value, would be diagonal. 

In equation (B) the coefficient of z, is larger in absolute value 
than the sum of the moduli of the other coefficients. We assumo 
equation (B) to be the second equation of the new system: 


2.52, + 5.82, — 0.52, = 3.5. (11) 
(2) From the remaining equations of the system we compose 
linearly independent combinations. Thus, we can take the linear 


combination (2C) -- (A) as the first equation of tho system, and 
then we have 


9.9z, — 1.52, + 2.623 = 0. (1) 

As the third equation of the new system we сап take the linear 
combination (2A) — (B), i.e. 

0.7z, + 0.423 + 742, = —1.3. (111) 

(3) As a result we obtain a transformed system of linear equa- 


tions (I), (11), (ІП) which is equivalent to the initial system and 
satisfies the conditions of convergence of the iteration process: 


9.9z, — 1.52, - 2.67, — 0, 
f 2.5:,--5.8г,--0.5т,--3.5, 
0.72; +-0.4=, + 7.42; = — 1.3. 


11-0104 
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Reducing this system to normal form, we have 
zı — 0.12, | 0.152, — 0.26z,, 
{ z, — 0.352, —0.21т„-{-0.42т„-{-0.05 
z3 = — 0.132; — 0.0724 — 0.0429 +0.29, 
O40 0.415 —0.26^ 
«| 0,35 -0.21 A 3 
— 0.13 —0.07 — 0,04 
|| æ |l = шах (0.58; 0.43; 0.72) = 0.72 < 1. 
it remains to solvo the system using ono of the iterative meth- 


ods. A 


Exercises 
1. Solve the following homogeneous systems of equations: 
(а) zd- Ал,-Ы2ла--!, (b) З, 4г,- 5т;-- 72,20, 
2r,-— 1,;--314--0, 2z,— 32,+ 3r,— 22z,—0, 
3z— 5z,+4z,=0, åz -H 14r, — 1323 4- 107, = 0, 
г, 172, 4|- Ата = 0); 7г1-- 27,41 zad- 3z,.—0. 


2. Test the following systems of equations for consistence and 
find its general solution and one special solution: 

(a) 22,;+72,+3ry-+ 24=6, (b) ү 22,—3z,-+ 5294 77,-- 1, 
32, +52, + 2734 22, — 4, СЕ 22:34 Зт, = 2, 
921414234 13--71,--2; 251 — 3t, — 1174 — 152, = 1. 

3. Use Cramer's formulas to solve the following systems of 
linear equations: 

(a) ( 221+ 244-423 —7, (b) f 11z--3y— 2= 15, 
2z,— z4— ту= —5, 2r --5y 4-5z — — 11, 
ӛт1--4т,-5а-- — 14; z4 yd 2-1. 

4. Use Gaussian climination method to solve the following 
systems: 


(a) ті--4т; —z4—6, (h) 2z,— zg4—2z,-- —8, 
Tit 1;--21,--ӛгі:- —1, 2,--24;- r= —1, 
Azr,-F3z,— їр 1,--1, тү— Т,- = —Ó, 
,--21,--3г4-- =, =: 3; — tı + 3T, — 214— 7. 


5. Use Gaussian elimination method to solve the following 
systems with an accuracy of 0.001: 
(a) 1.14z4 —2.15r,— 5.1174 = 2.05, 
0.422; — 1.132, J- 7.0524 — 0.80, 
—0.742, + 0.812; — 0.022, = — 1.07, 
(b) 0.61:-Б0.71у--0.05:-- — 0.16 
| — 1.032 — 2.05y + 0,872 — 0.50, 
2.52 —3.12y -+ 5.032 = 0.95. 


Ch. 3. Solving Systems of Linear Equations 163 


6. Use Gaussian elimination method to calculate the determi- 
nants: 


4 41 3 —46 54-77 34 
2459-13 —1 (| 82 44—23 02 
()34—|3 10 о) ®4=| 53-59 27 —79 
4-25 1 0.7 19—85 48 


7. Use Gaussian elimination method to invert the following 
matrices; 


122-4 ^ 032 0.52 —0.42 0.23 
276-4 0,44 —U.25 0.36 —0.54 

(а) А-|,;4 afp (©) А=) 106 0.74 —0.83 0.48 
004—4 0.96 0.82 0.55 0.36. 


Carry out the calculations to three decimal places and round off 
the answer to two decimal digits. 


8. Озо the method of successive approximations to solve the 
following systems of linear equations with an accuracy of 0.01, 
first determining the necessary numbor of iterations: 

(a) 8.72, — 3.12, 4- 1.823 — 2.22, = — 9.7, 
2.47, + 6.72, — 2.223 = 13.1, 
3.22, — 1.87, — 9.5z4 — 1.92, = 6.9, 
4.22, 4-2.82, — 1.423 — 9.92, — 25.1, 
(b) 6.1z--0.7y —0.05z = 6.97, 
1 — 1.382 —2.05y + 0.872 —0.10, 
2.5z — 3.12у — 5.03z = 2.04. 
9, Use Seidel's method to solve the systems of linear equations 


given in Exercise 8, first determining the necessary number of 
iterations. 


10. For the matrices 


—0.3 12-02 0,2 0,44 0,81 
(а) БЕ —0.2 d | (b) A= ls — 0,29 шт | 
—1.5 --0.3 0.1 0.05 0,34 0.4 
calculate the norms || A ||, || A |Ы and || А 
11. Uso the method of pivotal condensation to solve the follow- 
ing systems: 
(а) ӛг1--21,-5г;-Б z= — 5, 
2т1--Әг,-Б z44-5z4.— 7, 
ту-Е 2, —áz, = — 4, 
Ті-- Тұ-- 3z +97, = — 4; 
(b) 421--31,4- 1;--51,--7, 
124—224 —39z4 — 2z, — 6, 
32, — 224+ 57,4 —2z, — 0, 
2214-924 + 57,4 4- 4z, — -5. 
ЖЫ 
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12. Use Cholesky's scheme to solve the following systems of 
linear equations: 


8) 214-22, |323 Áz, — 5, 5 
2214 2,--22--3ғ.--1, (b) oy teed 
3z,+22,-+ 2;--2г,--1, 32,42 a ar 
4z44-3z,4-2z2,4- z= —5; 10215-7 Ig=4. 


Chapter 4 


Calculating the Values 
of Elementary Functions 


In calculations we often encounter the problem of 
finding the values of a function at a specifted point. In 
that case we must bear in mind that mathematically 
equivalent expressions not always prove to be of the 
same valuc when they are calculated. For example, to 
calculate the left-hand side of the identity 


a? + 2ab -+ b = (a + bF, 


we have i:i nerform four operations of multiplication and 
two operations of addition, and to calculate its right-hand 
side, we have to make only one addition and one multi- 
plication. 

Thus we arrive at asignificant problem of representing 
a function in optimal form in order to construct the algo- 
rithm of calculation of its values. We can understand the 
optimality in the sense of minimization of either the 
total number of arithmetic operations or"the time needed 
to calculate the values of the function. 


4.1. Calculating the Values of Algebraic Polynomials 


An algebraic polynomial of degree n is an expression 
of the form 


P (2) = aT” -]- ац"! + ... --а,ат Fan, (1) 


where the coefficients a,, Gi, . . ., а, are real numbers апа 
a, is assumed to be nonzero. The coefficient а, is a constant 
term of polynomial (1). 

The calculation of the values of an algebraic polynomial 
is a typical example of minimization of the number of 
computing operations. This problem is important in 
practical applications not only in its direct sense but 
also because it is closely connected with the problem of 
division of a polynomial by a linear binomial (a first- 
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degree polynomial), i.e. with the problem of finding the 
roots of a polynomial. 

A root (a zero) of polynomial (1) is every number Ё 
which turns this polynomial inlo zero when Ё is sub- 
stituted for тіп the polynomial, i.e. P (E) - 0. 

The root E of polynomial (1) is a root of multiplicity s 
(or an s-multiple root) if the polynomial itself and all of 
its derivatives up to the order х — 1 vanish at the point 
т — E and the sth derivative does not vanish at that 
point: 


Рв) Р' (Б) +... PDE, РО (8) 5 0. 


If the root of a polynomial is of multiplicity s = 1, then 
it is a simple root. 
Example 1. Determine the multiplicity of the root z = —2 
of the polynomial 
Р (х) = zh -H 713 + 18z? + 20z + 8. 
A We seek the first derivative P’ (г) = 425 -+ 21z? + 36r + 


20 and calculate P’ (—2) = 0. Then we find tho second derivative 
P" (г) = 12z* + 42r + 36. Wo have Р” (—2) = 0. Next we find 
the third derivative P'''(r) = 24z + 42. We have P''" (—2) = 
—6 +0. 

Thus the polynomial itself as well as its first and second deriva- 
tives vanish at the point z— —2 whereas its third derivative is 
nonzero at that point. This means that the root E — —2 has multi- 
plicity s — 3. A 

The principal properties of the roots of an algebraic 
polynomial are presented in 5.8. 

Consider the problem of calculating polynomial (1) 
at a point z = z*. То solve this problem, we represent 
the polynomial in Ше form 


Р, (2) = ал 4-2 (а 4.1 4- z (аһ -> +... Jc (a, 
+в)... @) 


To find the value of P, (z*), we calculate, іп succes- 
sion, 


by = а, 
b, =a, + x*b,, 
b, = a, + т*Ь,, (3) 


by = a, -F z*b,.,. 
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We сап sce from the ex pressions [or 5, that every successive 
coefficient b; results from the addition of the correspond- 
ing coefficient a; to the product of the predecessor b; 
by z*. 

When calculating P, (х*) and the coeflicients b, 
without using a computer it is convenient to use the fol- 
lowing table: 














Table 4.1 

dy | a, | аҙ | аҙ | ee. | @n-1 | an 
| і% z*b, z*b, | z*bgn.3 z*bn-ı 
o o pepe eS a | 





In the first row we write the coefficients of the polyno- 
mial P, (х) (we write the negative coefficients with the 
minus sign and omit the plus sign before the positive 
coefficients). We immediately transfer bo = ay to the 
third row. Then we multiply every coefficient b; by z* 
and write the resull under the next coefficient a, р. We 
sum up the numbers in the first aud the second row and 
write the result 6;4, in the third row. 

By virtue of the construction of the calculation process 
it is evident that b, = P, (2%). 

It is easy to calculate the number of operations needed 
to find P, (ау with the use of formula (1) we must per- 
form 2n — 1 multiplications and 2 additions and with 
the use of formula (2) we must make m additions and л 
multiplications. 

Thus formula (2) makes it possible to economize and 
almost half the number of multiplications. And if we 
take into consideration the fact that the operation of 
mulliplication requires much more time than the opera- 
tion of addition, we see that the use of calculating scheme 
(2) is rather efficient. 

Scheme (2) is known as Horner’s scheme. 
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Example 1. Using Horner's scheme, calculato the value of the 
polynomial P, (г) = z^ + 814-- 22834 $— z | 1 for = — 3. 
A We construct Hornor's scheme for this polynomial: 


1 3 -2 











ARE 
|з ја м 438 


1 | 6 | 16 | в | 146 | 439 — P, (3) 


Thus Р, (3) = 439. A 


It turns out that when realizing Horner's scheme we 
not only calculate В, = P, (z*) bul also find the coef- 
ficients b; (i = 0, 1, ..., n — 1) of the polynomial 


PU (2) = лі Вул"... + Ons (4) 
which is the quotient of the division of the polynomial 
P, (х) by the binomial x — 25: 

P, (2) — (x — x*) PT, (х) 4- P, (z*). (5) 
Indeed, removing the brackets on the right-hand side 


of relation (5), collecting terms and taking into account 
that P, (r*) = b,, we obtain 


P, (x)= byz" + (b, — ты) x"71 -|- (b, — x*b4) 272 
+ + + (On-1 -2%),)) z+ іһ- al ee 
From this we have 
d == бо, 
а ң-2%һ, 
аз =- b, — x * b, 
lün = b. -- Fal 
which is in complete accord with relations (3) and thus 
proves representation (5). 
We thus arrive at the following theorem. 
Bezout’s theorem. The remainder of the division of the 


polynomial P, (x) by the binomial x — x* is equal to the 
value of the polynomial for т = Т”. 
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Example 2. Calculate the value of the polynomial P, (г) =: 
4214 -+ 19:5 — 4 at the point z* = —2 and determine the coeffi- 
cients of the polynomial P(!) (z) which is the quotient of the divi- 
sion of P, (х) by tho binomial z + 2. 

A We construct Horner's scheme for the polynomial: 


12 | 19 





0 | 0 | -4 
| --24 | 10 | -20 | 40 


12 | —5 | 10 | —20 36 





Thus P, (—2) = 36 and РО) (т) == 12r? — 5r? -+ 10z — 20. A 


Another example of the пзе of Horner's scheme is а 
change of variable in a polynomial. 


Assume Са in polynomial (1) we have to pass to a new 
variable y which is in a linear relationship with the vari- 
able z: z—y--z*,ory-zr-—r*. 

This means that we have to find the coefficients of the 
polynomial 


Р,(у--2%)-- Ау" + 4,у"1--...-- As ay-F An (6) 
Wo can show that 
A, г P, (:%), 
Ana c PRA (2*), 
Anes UT PY, (z*), 


(qn) 
Ay Ро, 


where Р(х) is the given. polynomial (1) and the other 
polynomials 


РӨ, (а)- nah 4 ponen Lus a, 
(k= 1, 2, ...,n) 
are defined by the relations 
P, (z) — (2 — z*) РІ, (х) + P, (z*), 
Ра (2)  (z— ГУР, (х) + РУ, (z*), 


py"? (z) == (r— z*) po» + ppv (:%). 
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Thus we get the following simple algorithm for finding 
A; (j —»n,n—4,...,1, 0: 

1*. Using Horner's scheme, we calculate the coefficient 
A, = P, (z*) and also the coefficients b( (i = 0,1,..., 
n — 1) of the polynomial P{?, (т). 

2*. Applying Horner's scheme to the polynomials 
Py, (г), Pai; (2), ..., Р) (г), we calculate the coef- 
ficients A,_, = PO, (z*) and also the coefficients 


БНО (1—0, 4, ..., n — k — 1) of the polynomial 
POCO. (x). The process is completed when A becomes 
equal to п — 1. Then we set A, = PD = OM - ay. 
We have thus found all the coefficients. Aj. 

This algorithm is often called the generalized Horner's 
scheme. 

Example 3. In the polynomial P, (г) = 1224 -++ 19r? 4 pass 


to a new variable y =: z + 2. 
A Using relations (5) and (6), we compose a table: 

















12 19] 0 0 -4 
-24| 10 | —20 4n 
12 | —5| 40 | —20 | 36—4, 

—24| 58 | —136 
12 | -29| 68 | —156 = Ay 
—24 | 106 





12 | 53 |1474 =A, 
| -24 


12 | -77 =A 


12 =A, 
Thus the polynomial Q, (y) = P, (у - 2) has the form 
Qa (у) = 124 — 77y? -- A74y? - 156y + 36. A 


4.2. Calculating the Values of Analytic Functions 
The calculation of the values of an analytic function 


is often based on representing it as a quickly converging 
Taylor's series which is in many cases a convenient in- 
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strument for calculating the values of this function at 
the points belonging to the domain of convergence of the 
series. 

Assume that we have to find the value of the function 
1 (z) analytic on the interval |а, b] at the point z = z*, 
z* €[a, b] with a specified limiting absolute error в. 

Taylor's formula with the remainder in Lagrange's 
form for the function f (т) іп the neighbourhood of the 
point z — c, c € [a, b] has the form 


Қа)--Қо--(а-<) HO 


n А | 1+1) (c 
-...--(>--с) f£. —— , 
where с=с + 0 (2 с), 0<0 < 1. 
Consequently, Ше problem of computing / (x*) reduces 
to the calculaLiou of 


J @*) = S, (z*) + Rp (2%), 


where 5$, (2%) is the nth partial sum of the series: 


n (x*) EN y (r* — y I» 


i- 
(01-- 1, f (е) =f (e), 


and Н,(а%) is the value of the remainder H4: for 
2-:1%; 
пы pu (en) 


n, (2%). (2% — ‹ ) (nt T л) 


с%--с--0%(1%--о), 00% < 1. 


The algorithm of the solution of this problem is the 
following. 

1°, On the interval [a, b] we choose a point г = c as 
close to the point 2 = z* as possible and such that the 
function f (x) ilself and ils derivatives can be easily 
calculated for x — c. 

2°. We represent в as the sum 


e = & + 85 + Ep (1) 
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where в, is the residual error (the error of the method), 
€, is the limiting absolute error of calculation of 5, (z*), 
€, is the limiting absolute error of rounding off of the 
result. Generally speaking, e,, є, and eg can be arbitrary 
positive numbers satisfying condition (1). 

Іп practial calculations e is usually given in the form 
e = 10-7, where m is an integer. Then we usually assume 
that в, = 0.5-10-" and e, = e, = 0.25.10-", If there 
is vo error of the final rounding-off, then we assume that 
е == Е. = 0.5.10-", ғ, = 0. 

3°. We choose the number of terms іп 8, such that 
the inequality 


If (z*) — S, (z*)| = А, (z*) e, 
is satisfied. 

49, Each term in S, iscalculaled so that the approxim- 
ate value of S, differs from the exact value of S, by not 
more than e,. For that purpose, each term of S, is usually 
calculated with an absolute error ej/(n + 4). 

5°. The approximate sum 5, obtained in 4° is rounded 


off (if e, # 0) to the value S.. 
6°. The solution of the problem is written in the form 


f @*) = 5, + E. 


Example. Calculate ¢?-2 with an accuracy to within e = 0.01. 
A Taylof's formula with the remainder in Lagrange's form for 
the function сх in the neighbourhood of the point z = 0 has tho 
form 
gn 


z244 2,0 Z goor fU 
erates tat torte арау 


Since for large z Taylor's series of the function e* converges 
slower, it is expedient to calculate the value of c?-25 as the product 
с2.09.26 

The quantity e? can be easily calculated with any degree of 
accuracy and we can assume that practically the error of its cal- 
culation is zero. 

Let us assume that the errors of rounding off and calculation of 
07.60.25 are equal to 0.005. Then the error of calculation of 69-25 
із в = 0.005/е? = 0.0006. 

Thu: we have reduced the calculation of e?-3* with an accuracy 
of в = 0.01 to the calculation of 


воле 140.2504 09 рр 


with an accuracy of e = 0.0006. 


0 « 0 < 1. 








0.25^ ове 0.25"! 
nt Te (n3- 0 
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Assume, furthermore, that e; — 6, — 0.0003. We shall find n 
using the remainder of Taylor's formula for e* when z — 0.25: 
60.256 0.2541 
(n3- 1) 
Taking into account that 60-250 < 90.26 < 1.5, we gel n > 3. 
Consequently, we must calculate the sum 
0.25? 0.253 
$,—14-0.25-. —57— | 


with an absolute error 0.0003. Sinco we have calculated the first 
two terms with an absolute accuracy, it is sufficient to calculate the 
second and the third term with the limiting absoluto error of 
0.0001 each. Performing the necessary calculations, we find that 


S, = 1 + 0.25 + 0.0312 + 0.0026 = 1.2838. 


Multiplying the result by e?, we get e25, = 9.4860... . Finally, 
rounding off to the hundreds place, we get e*-35 = 9.49 + 0.01. A 





«0.0003; 0«c8— 1. 


We can similarly calculate the values of trigonomctric 
functions (sine and cosine). The corresponding Taylor's 
formulas with the remainder in Lagrange's form are 

А г? zb 
sinz—z—- + "Br 


n- gan-l n zmr 
— EC HY а АС 0)" pr 08 <1, 


‚ ‚ (2) 
сөзг-1- эг 
— (= 1) ob COD ag 0<0<!. (3) 


The argument in formulas (2) and (3) must be in radians 
and belong to the interval [0, л/4]. In that case the con- 
vergence of the corresponding series will be sufficiently 
fast. The reduction formulas and the known relation of 
trigonometric functions will make the argument belong 
to the indicated interval. 

Thus, for instance, to calculate the value of sin 2.53, 
we must use the reduction formula sin 2.53 — 
sin (x — 2.53); the argument л — 2.53 belongs to the 
interval [0, x/4]. To calculate the value of cos 1.27, we 
must use the formula cos 1.27 — sir. (1/2 — 1.27) and 
compute the value of the sine since (л/2 — 1.27) € 
(0, л/41. 


174 Computational Mathematics 


We write the condition for the choice of the number of 
terms n in calculating the value of the sine as 


gone 
"Und jr Ste rzCI0, 7/4], (4) 

and in the calculation of the cosine as 
air xe, 2610, 1/4). (5) 


‘Lhe formula for the expansion into series 


2 із 


ln (1 -- 2) cEg—-MAcbU 
000) 2 р: -4<т<40 (0) 


is hardly convenient for calculating Ше values of а log- 
arithmic function because of the slow convergence for 
|z | close.to unity. іп addition, this formula does not 
allow us to calculate the logarithms of numbers larger 


than two. 
To accelerate the convergence and expand the domain 


of applicability, we transform formula (6) as follows. 
Replacing x by -- on its right-hand and left-hand sides, 


we have 
1п(1—ж)=—хх—--—-—ы-—...—-——... 


Subtracting the initial relation from the resulting one 
we find that 
gin -1 
2 —2(2t+-F4+ $+... tite). 

Setting now (1 — 2)/(1 + А =z and bearing in mind 
that z = (1 — 2)/(1 + z), we obtain the initial formula 
for calculating the natural logarithm of any number z 
belonging to the interval (0, oo): 


һа--2 ER x) GS) 
(7) 


In practical computations, it is convenient to repre- 
sent the positive number z, whose natural logarithm must 
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be found, in the form 
т == 27.4, (8) 
where m is an integer and 
0.5 xiz « 1. (9) 
Then 
Ing —mln2- пл. 


It is easy to calculate the first [егт for the known m and 
In 2 = 0.00214718 . .., and the second term can be 
found from formula (7). By virtue of inequality (9), the 
quantity 


E —(1-—2zy( + 2) (10) 
varies in the limils 


0< Es 1/3, (11) 


and this ensures fast convergence of series (7). 
The final result is 





Inz..min2—2 (E eo EM )- Ra. (12) 


We estimate the remainder: 


_ fma pes | 22 ты 
Rn -2 (2—4 | Int | уара te 


Using inequality (11), we can reduce this estimate to 
the form convenient for comparison with the correspond- 
ing terms of series (7): 

g Е2п+1 Біл-і 
< 7 2n--1 А (2п-|-1)' 





ft, (13) 


To compute the value of a decimal logarithm, we must 
use the formula 


log z = M 1а =, 
where M = log e = 0.434294481903252 . . .. 
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4.3. The Iterative Method of Calculating the Value 
of a Function 


Consider one more artificial technique of calculating 
the value of the function 


y=f (ғ), (1) 


continuous on the interval |а, bl, al tho point z = 2”, 
z* <[a, b]. 

‘Ihis technique is based on the use of Newlon's method 
for solving algebraic and transcendental equations and 
consists in the following. 

1°. Function (1) is written in implicit form and the 
value of z* is substituted for z in the resulting expres- 
sion: 

F (z*, у) = 0. (2) 


The required value of the function y* = f (x*) is precisely 
the solution of this equation. 

2*. Equation (2) is solved by Newton's method, for 
which purpose the initial approximation yọ is chosen such 
that the condition 


F (z*, yo) Fiu (z*, Yo) > 0 (3) 


is satisfied and each successive approximation y, (n = 
1, 2, 3, ..-) is calculated from the formula 
Е (z* - ‘ 
Un = Unt) (n — 1, 2, 3, .. -). (4) 

The convergence of the iterative process (4) is ensured 
when the function F (2%, y) satislies the conditions of 
convergence of Newton's method. 

Note that there are numerous ways to represent ,func- 
tion (1) in implicit form (2), from which we must choose 
the representation such that the iterative process (4) 
would be convergent and the rate of convergence would 
be sufficiently high. 

An important example of this technique is the calcu- 
lation of the function y — yz (m = 2, 3, ...) in the 
interval (0, oo). 

It is expedient to use the expression ‘у" — = as 
F (z*, y) for this function. Then condition (3) is reduced 
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to the form 
yo 2 V z* (3') 
and the iterative process (4) to the form 
ye —z* , 
Yn “Yna — my Te (4’) 
Note that by virtue of the properties of the function 
y" — z*, the ileralive process (47) converges not only 
when condition (37) is fulfilled but also for any positive 
initial approximation yg > 0. In this case the condition 
Yn > y z* (п = 1, 2,...) will he fullilled for all the 
successive approximations. 


We can estimate the error of the approximation ул 
as follows: 


Ty oe - ут, 
Ау ya— y z* < y #2 (Un-i— Уһ), 


T* 
or 


"mn; 


— m—1 |, 
Ayn- А-а M. 


т-1 - 
3—' mna). (5) 





Since the case of m — 2 is encountered much more 
frequently, we shall give for it a more accurate estimate 
of the error. 

We represent 4% in the form a* = 25, where Kk is 
an integer 2% € 10.5, 1). Then, setting yg = 2Ё® , we 
obtain 


т 


= 25 1 \2"_ 25 1 үз 
Ayn == yn — V «* uni 5 ) < 8 Yo (=) . 





Example. Calculate у 34 with an accuracy of в = 10-4, 

_А In accordance with inequality (3°) we choose y, = 3.4 > 
y 34. Then, using formula (47) for 2% = 34 and yọ = 3.4, we find, 
in succession, y, and calculate Ay, from formula (5): 


3.43 — 34 . 
Yı -- 34—- Sap = 8.241, yy =O.08; 
t ез — 
Ya — 3.241— 3.2475 — 34 —3.23964, Ау,-2-40-9. 


3.3.24? 
Thus j 34 -- 3.23902 + 0.00002. A 
12—0104 
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Exercises 

1. Using Ilorner's scheme, perform the division of the poly- 
nomial P, (т) = z5 + 3z1 — 2:3 — z + 1 by the binomial z — 3. 

2 Find out whether Ё = 1 is a root of the equation z? + 223 — 
3 = 0. 
3. Use the expansion іп a power series with ап accuracy of 
e = 0.001 to calculate (a) sin 25°, (b) cos 20°, (с) In 4, (d) Ve, 
(e) cos 36?, (f) sin 18". 

4. Use the iterative method to calculate, with an accuracy of 
в = 0.0005, (а) V 12, (b) 1/56, (c) Y 42. 


Chapter 5 


Methods of Solving 
Nonlinear Equations 


5.1. Algebraic and Transcendental Equations 


In practical problems we often have to solve equations. 
We can represent every equation in one unknown in the 
form 


q (x) == g (2), (4) 


where б (х) and g (zr) are given functions defined оп a 
number sel X called the domain of permissible values of 
the equation. 

We can write an equation in one unknown as 


{ (т) = 0. (2) 


Indeed, transferring g (т) (о the left-hand side of equation 
(1), we get an equation 9 (х) — g (т) = 0 which is equiv- 
alent to (1). If we designate the left-hand side of the last 
equation as f (г), we get equation (2). 

The set of values of the variable = for which equation 
(1) turns into an identity is a solution of this equation 
and every value of x from that set is a root of the equation. 

For instance, the equation 2° = 2 — г has roots тү = 
—2 and z, — 1. Substituting —2 and 1 into the given 
equation for т, we get identities (—2)* — 2 — (—2), 
i.e. 4 = 4; 1? = 2 — 1, i.e. 1—1. 

To solve an equation is to find the set of all roots of 
the equation. [t may be finite or infinite. Thus the equa- 
tion considered above has two roots. The equation sin z — 
0 has a solution z = лл (n = 0, +1, -Е2,.. .). Assign- 
ing different values to n, we get an infinity of roots. 

A sel of several equations in several unknowns is a 
system of equations (the unknown denoted by the same 
letter in all the equations must mean the same unknown 
quantity). 


124 
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А solution of a system of equations in several unknowns 
is the set of values of the unknowns which turns overy 
equation of the system into an identity. 

For example, the system 

zi-py-8, 
( т-|-у%=8 
has а solution z = 2, y - 1 since for these values of the 
unknowns the equations of the system turn into identities: 
4--:125,2--1023. 

To solve a system of equations is to find the set of all 
its solutions or to show that it has no solutions. 

According as what functions enter into equations (1) 
and (2) equations are divided into two large classes, 
algebraic and transcendental equations. 

A function is algebraic il, in order Lo get the values of 
the function proceeding [rom the given value of z, we 
must perform arilhmetic operations and raise Lo a power 
with a rational exponent. (The operation of extracting 
a root can be represented as the operation of raising to 
a power with the exponent 1/n.) 

An algebraic function is rational with respect to the 
variable x if no operations except for addition, subtrac- 
tion, multiplication, division and raising to an integral 
power are performed which involve 2. 

For example, 


f, (х) = 294+ 157? — 12002 + 4, fa (2) = — + ES , 
fs (2) — (2— 4) (2+5), М0) soy + egg 


If the variable z does not enter into a rational function 
as a divisor or does not enter into the expression which 
is a divisor, then the rational function is an integral, 
or entire, rational function. 

For instance, the functions 


y = ает" + 211% + ...+ a, (n is a natural number 
ог Zero, 20, 04, . . ., ау are any real numbers with a, = О), 
=Z 2+8 


are entire rational functions. An entire rational function 
is defined throughout the number axis. 


Ch. 5. Methods of Solving Nonlinear Equations 181 


lf, in a rational function, a division by the variable z 
is encountered at least once or the variable т enters into 
the expression which is a divisor, then the function is a 
rational fractional function. 

For instance, the function 


_ быт 4 bye -l + Lis Eb 
where m is a natural number or zero, n is a natural num- 
ber, ао, 0,,. . ., бө, бі... are any real numbers (a, Æ 0, 
by Æ 0), is a rational fractional function. 

A rational fractional function is defined on the entire 
number axis except for the points at which the denomi- 
nator vanishes. 

А function is irrational if, to obtain the value of the 
function proceeding from the given value of т, we must 
perform, iu «addition to the four arithmetic operations 
(all or some of them), the operation of extracting a root. 
In that case, the function is irrational only if the argu- 
ment z is under the sign of the radical. 

Thus the function 


_ 3z?—4z--y z—1 
Y= — a4  — 


is irrational whereas the function 
4-Y3 , 5 
y y 3 zia VP r-|-4 


is nol irrational since z is not under the sign of the rad- 
ical. 

We have mentioned earlier that all rational and irra- 
tional functions belong to the class of algebarie func- 
Lions. 

Transcendental functions is another large class of 
functions. They include all nonalgebraic functions, i.e. 
an exponential function ах, a logarithmic function log, т, 
trigonometric functions sin z, cos т, tan z, cot z, in- 
verse trigonometric functions arcsin т, arccos 2, arctan v, 
arccot r and others. 

If the notation of an equation includes only algebraic 
functions, then the equation is algebraic. 
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For instance, the equations 
х5— 4 = 0, z*— 3294 ба —234+1=0 


are algebraic. 
An algebraic equation can be reduced to the form 


ах" + az" 4 а,2" +... Ба ,2+a,=0. (3) 


Therefore, when we say “ап algebraic equation", we usually 
hav» in mind an equation of form (3). 

If equation (3) has been obtained by means of the 
transformation of an equation which contained a rational 
fractional or irrational function, then we must take into 
account the fact that these functions are defined not 
throughout the number axis. 

For instance, the equation 


Ys—3 4 y6—z-3 


assumes the form 
4r? — 16z — 47 = 0 


after the function is rationalized. However, the initial 
equation is defined not on the entire number axis but only 
for z which belong to the interval [2, 6]. 

The numbers dp, а), ..., а, are the coefficients of 
equation (3) and may be real as well as complex. In what 
follows, we consider algebraic equations of form (3) only 
with real coefficients. 

To solve an equation in one unknown is to find its roots, 
i.e. the values of z which turn the equation into an iden- 
tity. The roots of an equation may be real or nonreal 
(complex). 

We can find the exact roots of an equation only in 
exceptional cases, usually when there is a simple formula 
for the calculation of the values of the roots which makes 
it possible to express them in terms of the known quan- 
tities. 

Thus, to find the roots of a quadratic equation of the 
form z* + pr + q=0, we use the formula 


nay La. (4) 
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To solve a cubic equation of the form z? + pr + д = 0, 
we use Ше formula 


— -4oy £48 
yg 2^ à 5 


+ V-V S48. (5) 


However, it is difficult to use this formula in practice 
since it requires the use of complex numbers. 

There is also a formula for solving a fourth-degree 
equation but it is so complicated that it is not employed 
in practice and we shall not consider it here. 

Abel, a Norwegian mathematician, has proved that for 
n > 5 there is no formula which would express the solu- 
tion of thy -!zebraic equation (3) by means of the arithmet- 
ic operations and the extraction of roots. Only in some 
special cases there may be formulas for solving algebraic 
equations whose degree is higher than four. 

In addition, the coefficients of some equations are 
approximate numbers and, consequently, we cannot pose 
the problem of finding exact roots. 

Therefore, of considerable importance are the methods 
of approximation of the roots of the equation f (x) = 0. 

In many practical problems it is not always necessary 
to find the exact solution of an equation. The problem of 
finding the roots is considered Lo be solved when the roots 
are calculated with the specified degree of accuracy. 

Then how must we understand the statement “the root 
has been calculated with the specified degree of accur- 
асу”? Let E be a root of an equation and z its approximate 


value with an accuracy of е. This means that | E— z |< 
e. If it is established that the required root E is between 
the numbers а and b, i.c. a « E « b, with ^ — a xz e, 
then the numbers а and b are approximate values of the 
root E, by excess and by defect respectively, with an 
accuracy of e since | E— a | «zb —ax;eand | Е — b | 
<%--а-< к. We can assume any number included 
betwoen a and 0 to bo an approximate value of the root Ё 
with an accuracy of e. 


184 Computational Mathernatics 


For instance, if the root Ё is between 3.228 and 3.229 
(i.e. 3.228 < E < 3.229), then, with an accuracy of 
0.001, we can take the number 3.228, 3.229 and any 
number included between them to be an approximate 
value of the root. 

In this chapter we consider the methods of approxi- 
mation of equations and systems of equations. Some of 
them can be employed in the solution of both transcen- 
dental and algebraic equations. Other methods can bo 
used to solve only algebraic equations. 


5.2. Separation of Roots 


The process of seeking approximate values of Lhe roots 
of an equation can be divided into two stages: (1) separa 
tion of the roots, and (2) computation of the values of the 
roots with the specified degree of accuracy. 

This section is devoted to the first stage, i.c. separalion 
of roots. | 

The root & of the equation f (г) = 0 is considered to bo 
separated on the interval (а, b] if the equation / (z) = 
has no other roots on this interval. 

To separate roots is to divide the whole domain of 
permissible values into intervals in ‘cach of which there 
is one root. There are two methods of separating roots, 
graphical and analytical. 

Graphical method of separaling rools. 1st technique. 
It is easy to separate roots if the graph of the function 
y — f (г) is constructed. The points of intersection of the 
graph and the z-axis yield the values of the root and it is 
easy, using the graph, to find two numbers a and b which 
include only one root between them (Fig. 5.1). 

2nd technique. All terms of an equation are divided into 
two groups, one of them is written on the left-hand side 
of the equation and the other on the right-hand side, i.c. 
the equation is represented as 9 (x) = g (х). Then the 
graphs of two functions, y = 9 (z) and y = g (=), are 
constructed. The abscissas of the points of intersection 
of the graphs of these two functions are the roots of the 
equation. Let the point of intersection of the graphs have 
abscissa zy and the ordinates of the two graphs at that 
points be equal, ie. Ф (zo) = g(z,). It follows from 
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Fig. 5.3 


Fig. 5.2 


Equations 
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this equality that т, is a root of the equation (Fig. 5.2). 
The numbers a and 5 which include the root between them 
can be determined from the graph. 


Example 1. Use graphical means to find the integers between 
which the roots of the equation z? — 3z — 1 = 0 are included. 
A ist technique. We construct the graph of the function y = 
z? — 3z — 1 (Fig. 5.3) and find the abscissas of the points of inter- 
section of the graph and the z-axis. The curve cuts the z-axis at 


Y4 





Fig. 5.5 Fig. 5.6 


three points, 'and, consequently, the equation has three real roots 
(note that a third-degreo algebraic equation has either one or three 
real roots). We can see from the drawing that the roots belong to 
the intervals [—2, —1], [—1, 0] and [1, 2]. 

2nd technique. We represent the equation in the forin z? = ӛг-- 1 
and construct the graphs of the functions z = z? and y = 3z + 1 
(Fig. 5.4). The abscissas of the points of intersection of the graphs 
of these functions are roots of the equation. The intervals of tho 
Separation of the roots can be easily found from the drawings. A 

Example 2. Use graphical means to separate tho roots of tho 
equation log z — З= -+ 5 = 0. 

A We rewrite the equation as follows: log z = 3z — 5. The 
functions on the left-hand and right-hand sides of the equation 
have a common domain of definition, the interval 0 < z < +œ. 
We shall therefore seek tho roots in this interval. 

We construct the graphs of the functions y — log т and y — 
3z—5 (Fig. 5.5). The straight line y = 3z — 5cutsthe logarithmic 
curve at two points. It is difficult to show on the drawing the inter- 
Section of the graphs of these functions at the first point. However, 
taking into consideration that the lower branch of the logarithmic 
curve approaches the y-axis indefinitely, we can assume that the 
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intersection of the graphs will be close to the point of intersection 
of the graph of the function y = 3z — 5 and the y-axis. Thus the 
roots lie on the intervals |0, 0.5] and [1, 2]. A 

Example 3. Use graphical means to separate the roots of the 
equation z — соз т = 0. 

A We rewrite the equation in the form z = cos х and construct 
the graphs of the functions y — z and y — cos z in the interval 
—л/2 < z < л/2. The graphs of the functions intersect at one 
point; in this interval thecquation has one root. Taking into account 





Fig. 5.7 Fig. 5.8 


the properties of the functions y = т and y == cos г, we can make 
sure that outside of this interval the equation has no roots. If we 
construct a more precise drawing, we can find that the root is on the 
interval [0.6, 0.8] (Fig. 5.0). A 

Example 4. Use graphical means to separate the roots of the 
equation 2* — 5z — 3 = 0 employing two techniques. 

A Ast technique. We construct the graph of the function y = 
2x — 5z — 3 and determine the abscissas of the points of inter- 
section of tho graph and the z-axis. The curve cuts the z-axis at 
two points, and, consequently, the equation has two real roots. 
It can be seen from the drawing that the roots lie on the intervals 
[—1, 0] and [4, 5] (Fig. 5.7). 

2nd technique. We represent the equation in the form 2* = 
5z + 3 and construct the graphs of the functions y = 2* and y = 
5z + 3. We find the abscissas of the points of intersection of the 
2227 tof these functions which are the roots of the given equation. 
We get the same intervals of separation of the roots [—1, 0] and 
[4, 5] (Fig. 5.8). A! 
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Remark. Assume that the graph of the function y = 
f (z) has the form given in Fig. 5.9. The curve cuts the 
abscissa axis three times and, consequently, the equation 
has three simple roots. 

Now if the curve touches the abscissa axis (Fig. 5.10), 
then the equation has a root of multiplicity two. For 


0 X= X X3\ x 





Fig. 5.9 Fig. 5.10 


instance, the equation z? — ӛт -|- 2 = 0 has threc roots, 
Ті = —2, т, = т, = 1 (Fig. 5.11). 

lf an equation has a real root of multiplicity three, 
then, at the point where the curve y = f (г) touches the 





Fig. 5.11 Fig. 5.12 


axis, it has a point of inflection (Fig. 5.12). For instance, 
the equation z? — 3z* -+ З= — 1 = 0 has а root of 
multiplicity three equal to unity (Fig. 5.13). 

The graphical method of separation of roots is not 
very precise.. It makes it possible to roughly determine 
the intervals of separation of the roots. Then one of the 
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techniques given below is used to compute the values of 
the rools. 

Analytical method of separating roots. We can separate 
the roots of the equalion f (х) = 0 analytically if we 
use some properties of functions studied in the course 
of mathematical analysis. 

We shall formulate, without proof, some theorems 
which must he known in order to separate roots. 





Fig. 5.13 


Theorem 1. If the function f (x) is continuous on the 
interval 1а, b] and assumes values of unike signs at! e end- 
points of this interval, then at least one root of the e “uation 
f (x) = 0 lies within this interval. 

Theorem 2. 7f the function ј (г) is continuous and mono- 
tonic on the interval (а, b] and assumes values of unlike signs 
at the endpoints of this interval, then there is а root of the 
equation f (x) = 0 within the interval (а, b] and that root 
is unique. 

Theorem 3. // the function f (x) is continuous on the 
interval (а, b] and assumes values of unlike signs at the 
endpoints of this interval and the derivative f' (т) retains 
sign within the interval, then there is a root of the equation 
f (x) = 0 within the interval and tha root is unique. 

Here are some data from mathematical analysis which 
will be needed later on. 
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If the function / (x) is defined analytically, then the 
domain of existence (domain of definition) of the function 
is the set of all the real values of the argument for which 
the analytical expression defining the function does not 
loose the numerical sense and assumes only real values. 

The function y = f (х) is monotonic in a given interval 
if it satislies the condition f (x4) >> (xj) or the condition 
/ (£a < f (ту) for any z, > z, belonging to this interval. 

If the continuous function y = f (x) has a derivative 
at all interior points of the given interval, then the neces- 
sary and sufficient condition for the monotonicity of tho 
function in this interval is tho satisfaction of the inequal- 
ity f' (т) Z2 0 or / (т) « 0. 

Let the function f (x) be continuous on the interval 
la, b] and assume values of unlike signs at the endpoints 
of thal interval and let the derivative /' (x) retain sign 
in the interval (a, b). Then, if at all points oj the interval 
(а, b) the first derivative is positive, i.e. f (x) с> 0, then 
the function f (x) increases in this interval (Fig. 5.14 a, c). 

Now if the first derivative is negative at all points of the 
interval (a, b), i.e. f (x) < 0, then the function decreases 
in this interval (Fig. 5.14 b, d). The root of the function 
is the abscissa of the point of intersection of the graph 
of the function / (x) and the x-axis. 

Assume that on the interval (а, b] the function f (x) has 
а second-order derivative which retains sign Lhroughout 
the interval. Then, if f° (х) — 0, then the graph of the 
function is conver downwards (Fig. 5.14 a, d); now if 
Ғ (x) << 0, then the graph of the function is convex upwards 
(Fig. 5.14 b, с). 

The points at which the first derivative of the function 
is zero and also the points at which it does nol exist (say, 
vanishes), but the function retains its continuity are 
critical points (this test is the necessary condition for 
extremum). 

If the function f (x) is continuous on the interval (а, 01 
then there are always points on this interval at which 
it assumes its greatest and least values. The function 
attains these values either at the critical points or at 
the endpoints of the interval. Consequently, to lind the 
greatest and the least value of the function on a closed 
interval, we must (1) find the critical points of the func- 
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tion, (2) calculate the values of the function at the critical 
points and at the endpoints of the interval fa, 01, (3) the 
greatest value found in ilem 2 will be the greatest and the 
least value will be the least value of the function on the 





f(a)«o, f(b)>0 Қа)>0, Қы)<0 
r(x)»0, ғ(д>0 f(x) <0, r'(x) «o 





f(aj«o, f(b)>0 f(a)»0, f(b)«o 
f'(x)»0. f'(x)«o ғ(х)<0, ғ(д>0 
Fig. 5.14 


closed interval. In accordance with the aforesaid, we can 
recommend the following sequence of operations to separ- 
ate tlie roots using the analytical method. 

(1) find the first derivative f (г), 

(2) compile a table of signs of the function f (x) setting 
z equal to: (a) the critical values (roots) of the derivative 
or ihe values close to them, (Ь) Ше boundary values 
(proceeding from the domain of permissible values of the 
unknown), 
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(3) determine the intervals at the endpoints of which 
the function assumes values of opposite signs. These in- 
lervals contain one and only one root cach in its interior. 


Example 5. Separate the roots of the equation 2* — 5z — 3 = 0 
using the analytical method. 

A We designate f (х) = 2* — 5z — 3. The domain of definition 
of the function f (г) із the entire number axis. We seck tho first 
derivative f’ (z) = 2* In 2 — 5. 

We equate this derivative to zero and calculate the root: 

2х112--5--0, 2*1n2-.5, 2x—5/1n2, 
z log 2— log 5 — log In 2, 

.,log5—logln2 0.6990--0,1592 0.8582 — 2.85 

log 2 ш 0.310 "0.8340 ^ OO" 

We compile a table of signs of the function / (z) setting z equal 
to: (a) the critical values (the roots of the derivative) or the 
values close to them, (b) boundary values (proceeding from the 
domain of permissible values of the unknown): 


2| 3 [te 


т | — с) 





The equation has two roots since the function twice changes sign. 
We compile a new table with smaller intervals of the separation 
of the root: 


' EBENEN - 
Sign ot  (2)| .1-І-1-|- 


Тһе roots of the equation are in the m" | о and 


(4, 5). A 





5.3. Computing Roots with a Specified Accuracy. 
Trial and Error Method 


The preceding section was devoted to the separation of 
roots, the first stage of solution of algebraic and trans- 
cendental equations. 

The second stage is the computation of roots with the 
specified degree of accuracy. 

We consider here some ways of relining roots used to 
solve algebraic and transcendental equations. There are 
techniques, however, which can only be employed to solve 
algebraic equations. We shall consider them later on. 
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Consider an equalion / (z) -- 0, where f (г) is a con- 
tinuous function. We have to find the root E of the equa- 
tion with an accuracy of e, where в is some positive suflic- 
iently small number. 

We assume that the root E has been separated and lies 
on the interval (а, b], i.e. there holds an inequality 
a < E xz b. The numbers а and b are approximate values 
of the root E by defect and by excess respectively. The 





Fig. 5.15 


error of these approximations does uot exceed the length 
of the interval b — a. If b — a xz e, then the necessary 
accuracy of calculations is attained and we can take either 
а or b as the approximate value of E. Now if b — a >€, 
then the required accuracy of calculations is not attained 
and the interval containing Е must be made narrower, 
i.e, the numbers а and b must be chosen so that the in- 
equalities a < E < b and b — a < b — a are satisfied. 
The calculations must be terminated when b —a <e 
and either a or b must be taken as the approximate value 
of the root with an accuracy of є. It should be pointed 
out that the value of the root will be more exact when we 
take the midpoint of the interval, i.e. с = (a + 6)/2, 
rather than the endpoints a and b, as the approximate 
valuc of the root. In this case the error does not excced 
the value (b — a)/2. 

Assume that the root Е of the equation f (т) = O[f (х) is 
8 continuous function] has been separated on the interval 
(а, b], i.e. f (a)-f (b) < 0, with b — a > е. We have to 
find the value of the root E with an accuracy of e (Fig. 5.15) 
13—0104 
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On the interval [a, b] we arbitrarily choose a point a, 
which bisects it into two intervals (а, ау] and [a,, 5]. 
Out of these two intervals we must choose the interval 
at whose endpoints the function assumes values opposite 
in sign. In the case being considered f (a)-f (a,) > 0, 
f (a) -f (b) < 0, and we must therefore choose the interval 
a,, b]. Then, on this narrowed interval, we again arbit- 
rarily choose a point a4 and find the signs of the products 





Fig. 5.16 


Í (a3) 1 (а) and f (a,)-f (b). Since f (a,)-f (0) <<0, we 
choose the interval [a,, 6]. We continue du process until 
the length of the interval on which the root lies becomes 
smaller than e. We obtain the root E as the arithmetic 
mean of the endpoints of the interval obtained; the 
error of the root does not exceed є/2. 

The method we have considered is known as the trial 
and error method. 

In the form considered above this method is not applic- 
able to calculations on computers. To compose a program 
and to make calculations on computers, it is used in the 
form of the so-called bisection method. 

Assume that the root E of the equation f (г) = 0 has 
been separated and lies on the interval (а, 5], i.e. f (a)* 
f (b) «0, with b — a > e [here f (х) is a continuous 
function]. Ás before, we take an intermediate point on 
the int^rval [a, b], not in an arbitrary way, however, 
but so that it is the midpoint of the interval [a, 5], i.e. 

= (а + b)/2. Then the point c divides the interval [а, b] 
into two equal intervals [a, c] and [c, b] which are equal 
in length to (b — а)/2 (Fig. 5.16). If f (c) = 0, then c 
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is the exact root of the equation f (г) = 0. Now if f (c) # 
О, then out of the two intervals Га, c] and (с, b] obtained 
we choose the interval at whose endpoints the function 
f (х) assumes values opposite in sign. We designate this 
interval as [a,, фу]. Then we again bisect the interval 
[a,, b,] and present the same arguments. We get an 
interval [a,, b,] whose length is (b — a)/2?. We continue 
the process of bisection until, at some nth stage, either 
the midpoint of the interval proves to be a root of the 
equalion (a case seldom encountered in practice) or we 
get an interval [a,, bnl such that b, — a, = (b—ay2" xz 
в and а, x; в x; b, (the number n indicates how many 
divisions have been performed). The numbers a, and 5, 
are roots of the equation f (г) = 0 with an accuracy of e. 
As was indicated above, we must take E = (a, + b,)/2 
аз the approximate value of the root. In this case the 
error dors ^ot exceed (b — a)/2n*!. 


Example 1. Use the trial and error method to make the smaller 
root of the equation z? -[- 3z? — 3 = 0 accurate to в = 10-3, 

A We use the analytical method to separate the roots of the 
equation. The function f (z) is defined throughout the number axis. 
Equating /” (г) to zero, we calculate the root of the derivative: 


f' (x) = За? -H 62,322 + Oz = 0,2 (z + 2) = 0,2, = 0, r, = —2. 
We compile a table of signs of the function: 


; кей ре 
seil |] +] —|—[[ +] + 
We see that the first root lies in the interval (—оо, —2). We 
try the root z = —3 and find that f (—3) = —3: 
tl |31?]|41|^?]|! 
smer;jl — 1 + | — | — 1 4+ 


This means that the roots of the equation г? + 3z? — 3 = 0 
lic in the intervals (—3, —2), (—2, —1), (0, 1). 

We rofine tho smaller root, which lies in the interval (—3, --.. 
using the bisection method. l'or the sake о. »nvenience, we com- 
pile a table (see Table 5.1). The signs — and + in the upper indices 
of аң and 5b, mean that f (ал) < 0 and f (bn) > 0. 

Thus the root of the equation z = —2.532. A 


13* 
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Table 5.1 
n а | „+ къл x3 зх2 | f Gg) 
41-3 -2 -2.500 | —15.625| 18.750 0.125 
11-3 -2.500 | —2.750 | —20.800| 22.689 | —1.111 
2 | —2.750 | —2.500 | —2.625 | —17.990| 20.670 | —0.320 
3 ` —2.625 | —2.500 | —2.563 | —16.840 | 19.701 | —0.139 
4 | —2.563| —2.500 | —2.532 | —16.230 | 19.233 0.003 
5 | —2.563 | —2.532| —2.548 | -16.540| 19.479 | —0.071 
6 | -2.548 | —2.532 | —2.540 | —16.390| 19.356 | --0.034 
7 | —2.540 | -2.532 | —2.536 | —16.310| 19.293 | —0.014 
8 | -2.536 | —2.532 | —2.534 | —16.270| 19.263 | —0.007 
9 | —2.534 | —2.532 | —2.533 | —16.250| 19.248 | —0.002 
10 | —2.533 | —2.532 


Example 2. Use graphical means to separate the root of tho 
equation 2? 1060.5 (т + 1) = 1. Calculate the root by the method 
of trial and error with an accuracy of e == 10-2, 

A We represent the equation in tho form logy., (z + 1) = 1/7? 
and construct the graphs of the functions y = loge, (x + 1) 





x 


y 7 logo «(x t 1) 
Fig. 5.17 


and y = 1/z?. Wo see from Fig. 5.17 that the equation has ono root 
т << —0.7. We determine tho signs of the function on the left and 
on the right of z,: 


т | -0.8 | —0.5 


Sign of f (2) | + | - 
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To make the calculations more convenient, we pass to the decimal 
logarithms: 


x „a log (z 4-1) _ „2 log (z4- 1) 
П) = 22 уро t= -—6934 —1 


We compile the following table (Table 5.2): 























Table 5.2 
- + 

л at | ы «ТЫН, х2 (шаған) Га) 
o | —0.8 | —0.5 | -0.65 | 0.4225 | —0.4559| —0.360 
1 | —0.8 | —0.65 | —0.73 | 0.5329 | —0.5686| —0.0067 
2 | —0.73 | —0.65 | —0.69 | 0.4761 | —0.5086 | —0.196 
3 | —0.73 | —0.69 | —0.71 | 0.5041 | —0.5376 | —0.099 
4 | —0.73 | —0.71 | —0.72 | 0.5184 | —0.5528 | --0.048 
5 | —013 | -0.72 


Thus z, = —0.73. A 


5.4. Method of Chords 


Тіс method of chords is oue of the most widely used 
methods of solving algebraic and transcendental equa- 
tions. In literature il is also encountered under the names 
of "the method of false position" (regula falsi method) and 
"the method of linear interpolation". 

Consider an equation f (г) = 0, where / (x) is a con- 
tinuous function which has derivalives of the first and 
the second order in the interval (a, b). Theroot is assumed 
to be separated and is on the interval [a, b], i.e. f (a)- 
/ (b) < 0. 

The idea of this method is (hat on a sufficiently small 
interval fa, b} the are of the curve y = f (x) is replaced 
by the chord subleuding it. ‘The point of intersection of 
the chord and the z-axis is taken as the approximate value 
of the rool. 

We have considered earlier various variants of the 
position of the arc of the curve depending on the signs 
of the first and the second derivative. 

1st case. The first and the second derivative are of the 
same sign, i.e. / (x) f" (т) — О. Assume, for instance, 
that f(a) «0, / (5) 0, f (2) > 0 and f (х) >0 
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(Fig. 5.18 a). The graph of the function passes through 
the points A, (a, f (9)), B (b, f (b)). The required root of 
the equation f (т) = 0 is the abscissa of the point of 
intersection of the graph of the function y = f (х) and 
z-axis. We do not know that point and, instead of it, 
take the point т, of intersection of the chord А,В and 
the z-axis. And this is the app» imate value of the root. 





Fig. 5.18 


The equation of the chord which passes through the 
points A, and B has the form 


y—{(a) — z—a 


Г) а)“ b—a* 
We seek the value of = = х, for which у-- 0: 


f(a) (b —a) 
7:5 0— 10) а) (0) 
The root Ё is now within the interval Іі, b]. If the value 
of the root т, does not suil our purpose, we can refine ib, 
applying the method of chords to the interval [z,, 01. We 
connect the point A, (z,, f (z,)) with the point В (b, f (5)) 
and find 7,, which is the point of intersection of the chord 
А,В and the z-axis: 


f (11) (b— ті) 


аа Fb) a) * 
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Continuing this process, we obtain 


Iy- 1,- Қт) (b — z;) 





f (5) — f (23) 
апа, in gencral, 
E f (zn) (b — zn) 
Ten In pU) P) С (2) 


The process goes on until we get the approximate root 
with the specified degree of accuracy. 

Тһе formulas given above are also used to calculate 
roots when f (a) 2> 0, f(b) «0, у (z) «0, f'(z) «0 
(Fig. 5.18 b). 

2nd case. The first and the second derivative are of 
unlike signs, i.e. f Cof G) « 0. Assume, for instance, 


_ 5 ln ed 
о А у=лду X 





Fig. 5.19 


that у (а) > О, / (b) <0, f/ (zx) «0, P (x) > 0 (Fig. 5.19 
а). We connect the points A (a, f (a)) and P, (b, f (b)) 
and wrile the equation of the chord which passes through 
the points A and Вы 


y— f(b) z—b 


f())—f() 5-а” 


We seek x, as the point of intersection of the chord and 
the z-axis, selling y = 0: 





p 1b) (6 —а) 
mo Ды шу (5) 
The root Е is now within the interval [a, 2,1. Applying tho 
method of chords to the interval (а, *,], we get 


__ f (zy) (zı —a) 
' Аб) — 0 (0) 








г,--7 
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and, in general, 

f (zn) (zn —2) 

Tend (4) 

Using these formulas, wo can also find the approximate 
value of the root when f (a) < 0, f (b) > 0, f (т) > 0, 
/7 (x) << 0 (Fig. 5.19 b). 

Thus, if f (z)-f" (2) с> 0, then the approximate root 
сап be found from formulas (1) and (2) and if f (х) х 
f' (zx) < 0, then it can be found from formulas (3) and (4). 

However, we can choose the convenient formulas em- 
ploying the following simple rule: the stationary endpoint 
of an interval is the endpoint for which the sign of the func- 
tion coincides with the sign of the second derivative. 

If f (Б): (т) > 0, then the endpoint b is stationary and 
we can take the endpoint a as the initial approximation 
[formulas (1) and (2041. Now if f (a)-/’ (х) 2 0, then the 
endpoint a is stationary and we must take the endpoint b 
as the initial approximation [formulas (3) and (4)]. 

Thus, as a result of the repeated application of formu- 
las (2) and (4), we get a monotonic sequence z,, Za, 2, 

.., Т, Which converges to the value of the root Ё. 

To estimate the error of approximation, we can use 
ihe formula 


Tnt Dg — 


[E— z,] < Iz, — 2.4]; (5) 
where Ё is the exact value of the root and z,., antl х, 
are its approximations obtained at the (n — 1)th and 
nth stages. It can be used when the following condition 
is fulfilled: 


M<2m, where M = max |} (x)|, m — min ff’ (x)|. (6) 
(2,51 (а, b] 


Example 1. Use the method of chords to make the smaller root 
of the equation 23 + 3z? — 3 = 0 accurate to е = 0.001. Tho roots 
of the equation have been separated and the smaller root is on the 
interval [—3, —2] (see Example 1 in 5.3). 

A We verify the fulfillment of condition (6): 

If’ (z)| = 132? 4-62], 
M= max |f'(z)| = |27 —18| =9, 
4. -3, -2] 
m= шіп |)”(2)|--|12--12|--0, М> 2m. 
[-3, -2] 


We take the midpoint of the interval [—3, —2], i.e. the point 
х = — 2.5, and choose the interval | —3, —2.5]. We again verify 
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the fulfillment of condition (б): 


M= шах [f'(z)|=9, m= min |/'(z) 3.75, 
[-3, -2.5] {-3 2.5) 


M 2m. 


Now we tako the imidpoint of the interval [—3, —2.5], i.e. 
the point z = —2.75; we have f (—2.75) < 0, у (—2.5) > 0, 
f (—3) < 9. We choose the interval [—2.75, --2.5] and find that 
М-- тах tf’ (z)| 26.489, m= max 117 (т)! =3.75, 

[-2.75, -2.5] [-2.75, -2.5] 


i.c. in this case the condition M < 2m is fulfilled. 

Thus, to estimate the error of the root lying on the interval 
[—2.75, — 2.5], we can use formula (5): | Ё — z, | < | 2, — 232 |, 
i.e. we must continue tho process of the successive approximation 
of the root until the condition | т, — z,_, | < e is fulfilled. 

We determine the sign of the second derivative and find the 
formula which must bo used for calculations. We find that f" (z) — 
6r + 6. The inequalities f (—2.75) << 0 and f (—2.75).f^ (z) > 0 
hold true сп the interval [—2.75, --2.5|. This means that we must 


take z = —7 75 as the stationary endpoint of the interval. Then 
we must use toruulas (3) and (4) to carry out the calculations: 
f (a) (b — a) f (zn) (zn — а) 
mb————F-. fnucfig——— 1 
^ П) F(a) бла 7 fi) -— а) 
where a -- — 2.75 and f (a) — —1.111. If we represent the last 


expression as 
Í (zn) (xn —а) 
121) — Ра) ' 
we can at once get the difference of the two successive approxima- 
tions and vcrify whether we can terminate the calculations, i.e. 
whether the inequality |ті — z, | Se is satisfied. 

It is convenient to use the following table to carry out ‘he cal- 
culations: 





Tni — Tn 





Table 5.3 
els 
ер о CIL 
3 D 2 1. Iu 
n Yn "n e" зу, т Ха-а E ы 
із ~ 
tl _ uL IMEEM 
0]—2.5 -- 15.625 16.250 | 18.75 0.125 [0.25 | —0.025 
1 | —2.525 |—16.098/[6.3756| 19.1268 | 0.0288 |0.225| —0.006 
2|—2.534 | —16.213/|6.4060| 19.2180 | 0.0050 |0.219| —0.0009 
3 | —2.5319 


We can sce from Table 5.3 that | 2, — z, | < 0.001 and, there- 
fore, rounding off to the thousands place, we get § = — 2.532. А 
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Example 2. Use the method of chords to make the root of the 
equation z — sin z = 0.25, which is on the interval |0, л/2), 
accurate to e = 0.001. 

А We write the equation in the form z — sin z — 0.25 = 
and [ind у (т) = 1 — cos x. To verify whether condition (6) is 
fulfilled, we compile an auxiliary table whose first two columns in- 
dicate the origin and the endpoint of the chosen interval of the 
separation of the root. 








Table 5.4 
Signs of Fulfill- Si 
n f Sign of 

a b C77] M т the con atb f (C + b) 
fia) | fon die 7 2 
0.00 [1.57 — + 41.00 no 0.785 — 
0.785|1.57 -- 1.00 |0.2925 по 1.178 + 
0.785|1.178| — + |0.61720.2925 no 04,982 -- 

0.982 | 1.178] - || 10.61720 .4446 yos 





We sce from the last row of the table that on tho interval [0.982, 
1.178] the condition M < 2m is fulfilled. Consequently, when using 
the method of chords to estimate the error of the approximation of 
the root, we can employ the inequality | х, — Zn-1 | < €. The 
root of the equation т — sin z — 0.25 = 0 is оп the interval 
10.982. 1.178]. We determine the sign of the second derivative within 
the interval: 

f (т) = 1 — cos r, f” (т) — sin z > 0, 
If we return to the old designations, then a — 0.982 and b — 
1.178. The sign of the second derivative coincides with the sign 
of the function at the point b. Consequently, this endpoint. of the 
interval is stationary and all the approximations of the root are 
from the side of the endpoint a. We use formulas (1) and (2) to 
calculate the root: 


Га) (Фа) , SF (£n) (та) 
П) = а) "7" Fb) ута)" 
whore b = 1.178, f (b) = 0.00416. We compile the following table: 














Table 5.5 
Од) х Ў (хп) (0 хд) 
п | Tn | танап loghi ores] ^7 ^а j- СЕЗСЕ 
n | 0.982 —0.83161 | --0.09961 0.196 0.189 
1 1.174 — 9.92114 —0.00044 0.007 0.0002 
2 1.1712 





Thus z = 1.171 with an accuracy of e = 0.001. A 
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5.5. Newlon’s Method of Approximation 


Newton's method is another method of iteration. 

Assume that the root of the equation f (г) = 0 has been 
separated on the interval (а, b] and /' (т) and f” (г) are 
continuous and retain constant signs throughout the 
interval (а, bl. 

In terms of geometry, the meaning of Newton's method 
is that the arc of the curve y = f (т) is replaced by a 





Fig. 5.20 


tangent to that curve (hence, this method is sometimes 
called the method! of tangents). 

1st case. The first and the second derivative have the 
same sign. Let f (a) < 0, f (b) > 0, f (x) > 0, f" (т) > 0 
(Fig. 5.20 a) or f (a) > 0, f (b) < 0, у (2) «0, f" (z) < 
0 (Fig. 5.20 b). We draw a tangent to the curve y = f (2) 
at the point В, (b, /(0)) and find the abscissa of the 
point of inlersection of the tangent and the z-axis. We 
know that the equation of the tangent at the point 
B, (b, f (b)) has the form 


y — f (b) = f' (b) (= — 0). 
Selling y = 0 and £ = z,, we oblain 


pol [ (b) 

44- b— T 5 . (1) 
The root of the equation is now on the interval |а, ку]. 
Using again NewLon’s method, we draw a tangent to the 
curve at the point В, (z,, f (z,)) and obtain 


f (ту) 
Г! (ту) 


т; uc zy 
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and, in general, 





f (zn) (2) 


T шГд-- 
ntl n f fm 


We get a sequence of approximate values z,, z,, ... 
In, +++, every successive term of which is closer to tho 
root E than its predecessor. However, all т, remain larger 
than the exact root &, i.c. z, is an approximate value of 
the root Ё by excess. 

2n case. The first and the second derivative are of 
unlike signs. Let f (a) < 0, f (b) > 0, f (2) > 0, f" (x) < 
0 (Fig. 5.21 a) or f (a) > 0, f (b) < 0, / (z) «0, f” (z) > 





Fig. 5.21 


0 (Fig. 5.21 b). If we again draw a tangent to the curve 
y — f (x) at the point B, it will cut the abscissa axis at 
the point which does not belong to the interval [a, 5]. 
We therefore draw a tangent at the point А, (a, f (a)) 
and write its equation for this casc: 


y — f (a) == ]' (а) (x — a). 

Setting y == 0 and z = ду, we find that 
Ti :а----т;. (3) 
The root Ё is now on the interval [z,, b]. Using again 


Newton's method, we draw а Langent al the point 
A, (zy, f (т1)) and get 
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and, in general, 


Ты 2 Ба . (4) 





We get a sequence of approximate values ту, Za, . . ., Tns 
. ., each successive term of which is closer to the exact 

value of the root E than its predecessor, i.e. z, is an 

approximate value of the root E by defect. 

Comparing these formulas with those derived earlier, 
we note that they differ only by the choice of the initial 
approximation: in the first case we assumed the end- 
point b of the interval to be х, and іп the second case, the 
endpoint a. 

When choosing the initial approximation of a root we 
must be guided by the following rule: the endpoint of the 
interval la, b] at which the sign of the function coincides 
with the sign uf the second derivative must be taken as the 
initial point. In the first case f (5b)-/" (х) с> 0 and the 
initial point b = z,, in the second case f (a) -/" (х) >> 0 
and we take a = д, as the initial approximation. 

То estimale the error, we can use the general formula 


[E-— z, | «9 | ‚ Where т= min [f'(z)| (5) 
т [a, b] 


(this formula can also be used for the method of chords). 

When the interval (а, b] is so small that the condition 

М, < 2m, where ЛІ, = max |/"'(z)]|] and m, = 
la, b] 

min |/ (т) |, is fulfilled on it, the accuracy of approxi- 


а, 


mation at the nth stage is estimated as follows: if 
|1, — Zna [< e then |Е--т, |< €. 


If the derivative /' (x) varies but slightly on the inter- 
val (a, bl, then, to simplify the calculations, we can use 
the jormula 


Таныс T8 — S , (6) 





i.e. it is sufficient to calculate the value of the derivative 
at the origin only once. In terms of geometry this means 
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that the tangents at the points B, (Zn, f (г,)) are replaced 
by straight lines which are parallel to the tangent drawn 
to the curve y = f (z) at the point By (ro, f (xz) 
(Fig. 5.22). 





х A b-Xo x 





Fig. 5.22 


Example 1. Use Newton's method to find the root of the equa- 
tion 22 4- 3132 — 3 = 0, which lies on the interval [--2.75, —2.5] 
with an accuracy of & — 0.001. 

A We have established the fact that f (-2.75).)” (х) >> 0 (see 
Example 1 in 5.4). Therefore, to use the method of tangents, we 
must choose г; = —2.75. We shall use formula (6) to carry out 
the calculations. We find that 


Ғ (z) = 32? -|- бт, р (za) = f (—2.75) = 6.1875. 
For the sake of convenience, we shall use Table 5.6, from 


which we can see that | =, — =; | < 0.001, and, therefore, Ё — 
2.533. А 


Table 5.6 
3 2 2 Í (xg) 
n | Yn | in | x. | 3x IEn) |- 6 i8TS 








—2.75 |-20.797| 7.5025 | 22.6875 | —1.111 | 0.179 
—2.571 | —16.994| 6.6100 | 19.8300 | —0.164 | 0.026 
—2.545 | —16.484| 6.4770 | 19.431 —0.053 | 0.008 
—2.537 | --16.320| 6.4364 | 19.309 0.020 | 0.003 
72.53 -16.271| 6.4212 | 19.2636 0.007 | 0.004 


OOF we > 
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Example 2. Use Newton's method to find theroot of the equa- 
tion z — sin т >= 0.25, which lies on the interval [0.982, 1.178], 
with an accuracy of & -- 0.0001. 

A Here we have а = 0,982, b = 1.178. We find that f’ (т) = 
1 — cos z, /" (т) = sin г > 0 on [0.982, ї 178], (1.178)./” (т) с> 0. 
Consequently, т, = 1.178. Wo use formulas (1) and (2) and 
Table 5.7 to carry out the calculations. Wo can see from Table 5.7 
that | z4— х, | < 0.0001. Thus E c 1.1712. А 

















Table 5.7 
А Í (хп) = х fp) f (xp) 
n | *n | mx, | sin, 0.25 -і- COS Xp 7 TG 
0 | 1.178 —) 92384 0.00416 0.01723 —0.0065 
1| 1.1715 —0.92133 0.00017 0.61123 —U.0002 
2| 1.1713 —1.92127 0.00003 0.61110 —60.00005 
3 | 1.17125 


5.6. The Combination of the Method of Chords and 
Newton’s Method 


The method of chords and Newlon's method yield 
approximations of a root from different sides and there- 
fore are often used in combination. Then the accuracy of 
the root increases much quicker. 

Assume that we have an equation f (z) == 0. Тһе root 
E has been separated and is on the interval (а, 51. Taking 
into account the type of the graph of the function we 
employ the combination of the method of chords and 
Newton's approximation method. 

If f («УР (x) => 0, then the method of chords yields 
approximations of the root by defect and Newton's method 
yields approximations by excess (Fig. 5.23 a and 8). 

Now if f' (х) -f" (г) < 0, we can use the method of chords 
to get the values of the root by excess and Newton's method 
to get the values by defect (Fig. 5.24 a, b). 

However, in all cases the true value of the root is be- 
tween the approximate values of the roots obtained by the 
method of chords and Newton's method, i.e. there holds 


an inequality a < т, < Ё < Tn < b, where z, is the 


approximate value of the root by defec: and г, by excess. 
The calculations must be carried out as follows. If 
f (xf'(x) 20, then we must take the endpoint a as 
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Fig. 5.24 


the initial approximation for the method of chords and 
the endpoint b for Newton's method and then 


2g L@) (b—2) р tb) 
a—-a——5e—; ^ b= b— Frey (1) 


The true value of the root is now on the interval [a;, 5,1. 
Applying the combined method to this interval, we 
f (21) (bı — 81) f (b) 


Fia  ? — bi— Fo) 


obtain a,=a,— 


and, in,general, 





an 


f (ап) (bn —an) ы — 1 (bn) 
fa) 00а р) (2) 


(see Fig. 5.23 а, b). 
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Now if f' (z)-/" (г) < 0, then we must take the end- 
point b as the initial approximation for the method of 
chords and the endpoint a for Newton's method. Then 
we have 

о 1 (a) р В) (b —a) 
аа ау a=b pag а). (3) 

Applying the combined method to the interval [a,, 5,1 

we got 


—a ал) — p __ F0901—2a) 
= 0 — ray: Phi ray 
and, in general, 
f (аһ) f (bn) (bn —an) 


бн аа ран)? бн Рата) а) 9 
(see Fig. 5.24 a, b). 
The combined method is very convenient for the eval- 


uation of tho error of calculations. The process of 
caleulatizns i» terminated as soon as the inequality 


г, --1, | < e is satisfied. We must take 
1 -- = 
Е- 79 (Zn + Tr) (5) 


where z, and т, are the approximate values of the root 
by defect and by excess respectively, as the approximate 
value of the root. 


Example. Use the combination of the method of chords and 
Newton's method to find the roots of the equation z? + 3:2 — 
24r + 1 = 0 with the accuracy of 0.001. 

A (1) We separate the roots analytically, and have 


f (z) == z? + Зх? — 24r +1, у (х) = 3r? + Gz — 24, 


i.e. the roots of the derivative are гі = —4 and г, = 2. We com- 
pile a table of signs of the function: 

7 [>H P 

Sign of f (г) | - | + |_| + 


The equation has three real roots: т, € (—оо, --4), ғ, € (—4, 2), 
тз € (2, +00). We diminish the intervals of seeking the roots, 
making them equal to 1: 


т |=" [75|75475|73]72 |-ро рр рар 


14--0104 
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Thus, г) € (—7, —6), 2; € (0, 1), г; € (3, 4). 

(2) We use the combination of the method of chords and New- 
ton's method to make the root lying in the interval co —6) 
more preciso and get f(—7)-- —27 < 0, f(—0) = 37 >0, 
у (т) == 32° + бх — 24 > 0, f" Qr) = br бс 0, f^ ar (д) < 


` We calculate employing formulas (4): 








Í (ал) _, _f (bn) (bn — an) 
апа no prap]? PSO fee) fau) ' 
i.c. 
Gn,17 0p d-Aag, whero An,- -- La) , 


Í (bn) (bn — an) 
f (bu) — f (ал) 


(а, and b, are the approximate values of the root by defect and 
by excess "respectively). Here a, = a = —7, b, = b = —6. 

It is convenient to carry out the calculations using a tablo (seo 
Table 5.8). 

Taking into account that | b,- о, | = 0.0007 < 0.001, we 
must terminate the paetos and take 


bnai=bna+Ab;, where Ab, =: — 








t= F 1 — 6.6384 — 6.0377) = — 6.638 


as the approximate value of the rool $. 

(3) Let us estimate the approximate value of the root for the 
interval (0, 1). We have / (0) > 0, f (4) <0, f (т) = 32% + 
6z — 24 < 0, f" (z) = 62 4-6 > 0, / (тг) (oc. As in the 
first case, we use formulas (4) for ag ` а = 0, : 4. 

We compile a table (see Tablo 5. 9). Thus we can take Е, = = 0.042 
with an accuracy of 0.001. 

e Let us now find the арргохішліс value of the root belonging 
to the interval (3, 4). We have f (3) - --17 < 0, f (4) = 17 > 0, 
f (e) = 38 62'— MIO feo 0 o rere 


` We use formulas (2) to carry out the calculations: 
La — Í (an): (bn —аһ) Í (bn) 
бааа а) fs) * MM FRY? 

і.е. 

f (an) (bn — an) 

f (bn)—f (ân) ' 
Í (dn) 

1' (bn) ` 


an1 =n + Аал, where Лар = — 


bası =bn + Abn, where Abn=:— 


Неге а, = a = 3, by = b = 4. 
We reduce the calculations to a table (see Table 5.10). 
Thus we can take Е, = 3.596 with an accuracy of 0.001. A 
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5.7. The lterative Method 


The gist of the method. Tho iterative method, or the 
method of successive approximations, is one of the most 
important methods in computational mathematics. The 
main advantage of this method is that the operations 
carried out at each stage are of the same kind, and this 
makes it considerably easier to set up programs for a 
compter which are based on iterative algorithms. 

The gist of the iterative method is the following. Con- 
sider the equation 


j (2) = 0. (1) 


Let f (т) be a function, continuous on the interval (а, 51 
which vanishes within this interval at least at one point E. 
We have to find at least one of its real roots, which lie 
оп (а, b], with a specified accuracy. 

We replace equation (1) by an equivalent equation, 
іс. by an equation which has the same roots, say, by 
an equation of the form 


x = Ф (л). (2) 


We choose some value 7, Є (а, bl, say, to = (a + Ь)/2, 
as the initial approximation. Then we calculate Ф (гу) 
and assume the resullant number г, = 0 (zy) to be the 
first approximation of the value of the root Е. Substitut- 
ing гү for т on the right-hand side of equation (2), we 
get a new number 7; = @ (2,). Continuing this procedure, 
we arrive at a sequence of numbers ze, Tis Tas ..., Ту, 
. ., Which are defined by the following relations: 


Ly = (a + 5/2, х, = (7,1) (п--1,2,...). (9) 


If there is a limit lim 2, = E and the function 0 (=) is 


п- 


continuous, then we can pass to the limit in relation (3) 
and obtain 
E = ф (B), (4) 


i.e. the limit Ё is a root of equation (2) and, consequently, 
of equation (1) as well. Since process (3) is convergent, 
for a sufficiently large n this root can be calculated with 
any specified accuracy. 
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Note that Шеге are infinitely many ways of arriving at 
representation (2) [i.c. at the form of the function q (z)]. 
This is very significant since the form of the function 
q (r) is of à considerable importance both for the con- 
vergence itself and for its rate (provided that the fact of 
convergence has been established). 

The following theorem defines the conditions for con- 
vergence of the iterative process (3). 

Theorem. Assume that the following conditions are ful- 
filled: 

(1°) the function Фф (x) is defined and differentiable on the 
interval [а, 0], 

(2°) all the values of 9 (г) Є (а, b] for z € (а, Ы, 

(3°) there is а number q < 1 such that 


Ie (0) 1<9<1 (5) 


for x € la, Ы. 

Then the iterative process (3) converges irrespective of 
the choice of the initial approximation т, € la, b) and 
lim z, is the unique and simple root of the equation x = 


q (o) on the interval (а, b]. 
O We set up the following differences: 


L5 — Tal = [Ti — Zl, 
Г 24] —- 19 Qu) — Фф (0) 19" (с) 1-12, 20] 
qlr iol, 
аж, = |Ф(т„)—Ф(т,)| = Ie" (с) [- 124 — {| 
«qz re. 
[tn т“ | = [Ф (22-4) --% (£53)! 
KA (с,)| -|Tn-1 — Ta. 3| S q'|z,-- zl. 
Here с, € [n-i т.) and za € [a, b] by virtue of condi- 


lion 2 
Consider a series with the following partial sums: 


Sasa >= Ty + (г — To) He (т, — д) «c 


+ (tn — Irae A) teen 
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It is evident that $,4, = z,. The series zy - У) (r;j4, — 
1=0 


24) is convergent since all of its terms beginning with 
Т, — Т, do not exceed, in absolute value, the terms of 
the geometric progression with a common ratio q < 1. 
Hence there is a limit 

lim $,,,— lim z, = E. 

n> оо п-» со 

бі се the function ф (x) is continuous, we have 

lim 9 (2.1) = % (E) and since 2, = @ (2-1), it follows 


"no 
that p (£) = Ё, і.е. E = lim т. is a root of equation (2). 


Let us prove that this TOOL is unique. Let Ё, and Ё, ре 
two roots of equation (2), i.e. E, = Ф (Ej) and 5, = 
Ф (5). Then 


|5, — 5. | = [Ф (5) — Ф (5,) 1 
= | œ (с) 1:15, — 5 l (6) 


where c Є (Ej, Ej). We reduce relation (6) to the form 
15 —&51( —19 (0n =0 


and then it follows from condition 3° that Ё, = &,, i.c. 
the two roots are not distinct. 

Let us finally prove that the root obtained is simple. 
To do this, it is sufficient to prove that z — Фф (z) has a 
derivative which does not vanish аі any point of the 
interval [а, Б]. Indeed, (x — ọ (x) = 1 — ф (т), and 
it is evident, by virtue of condition 3°, that this expression 
is positive on Ía, b]. Ш 

The estimate of the error. Consider the diíference of 
the exact and the approximate value of the root Ё: 


|Ё— „| = 1e (B — Ф (22-1) 1916 — ха] 
—-g|E—2z,4-z, — z, 4| g|E— In| q1z4 — 14-41. 
From this we have 


n 
р tn taal Am 160—2]. (7) 


4 


Relation (7) makes it possible to find, already after the 
first iteration, the maximum number of iterations N (E), 
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necessary to calculate tlie root with the specified accuracy 
в. Indeed, for | £ —.r, | to be not larger than e, it is 
sufficient thal 


TL 
34-4 [7 9l «e, 
whence we have 
log e (1—9) 
N (e) > — M nel (8) 
= log q . 


For 4 << 1/2, tlie estimate of the error becomes simpler 
and assumes the form 


[5 — rn | |44 — Tn |. (9) 


We have mentioned that the form of the equation т = 
ф (г) is of importance for the convergence of the iterative 
method. We shall now show a sufficiently general tech- 
nique for constructing the funclion q (x), for which the 
fulfillment of condition 3° of the theorem is ensured. 
Let us consider the initial equation f (г) — 0. Assume 
that there is a unique root Ё of the equation on the in- 
terval (а, b] and that the derivative / (2) exists for 
t Cía, bl and retains sign so that 
т<Г (4) < M, where M, = шах f’ (г); 
[a, b] 
m, — min f' (г) (10) 
(а, б] 
(without loosing generality, we can assume that f (г) > 
Q). 
We replace the equation ў (г) = 0 by an equivalent 
equation 
T = T —Af (г) (11) 


and choose the constant A which would ensure the ful- 
fillment of condition 3°. 

For the function ọ (z) =z — Af (x) condition 3° is 
written as follows: 


I1 —M' («1 


We solve this inequality and һауе —1 < 1 — А (z) < 
1. From the right-hand inequality we find that А > 5 
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and from the left-hand one we get A < 2/f' (x), іл. 
0 « X —2/f' (x), x Ela, bl, 
or 
0 <А < 2/M,. 
We usually assume 1/M, to be A. Thus we get an 
equation 


Қа) 
т--г--“ұ- 3 (12) 
and ile corresponding iterative process has the form 


UL: (13) 

Reasoning by analogy, we can show that in the case 
Г (2) <0 and O<m<[f' (z)|«: M, we get an 
equation 


f (z) 


and (Ше corresponding iterative process assumes the form 
f (zn) 94 

x эви] ыы 13 
nti n M, ( ) 


We assume now that in addition to condition (10) we 
have a relation 


M, x дт. (14) 
Then we may require thal the inequality | 1 — Xf (à) | x5 


1/2 should be satisfied. Solving it, we get the following 
restrictions for А: 





{ 3 - 

2m, S Ml (1 ) 

Geometric interpretation. Consider an equation f (x) == 

О [f (т) is a continuous function]. We reduce this equation 

to the form z = ọ (х) and construct the graphs of the 

functions y = x and y = q (z). The abscissa of the point 

of intersection of the graphs of these functions is the 
irue root E (Fig. 5.25). 

We choose 2, € (а, b] and determine Ф (ту). We designate 

the sequence of points lying on the curvo y — «p (z) as 
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A; (6-0, 1, 2, .. .) and Ше sequence of points lying 
on the straight line y = z as B; (i = 1, 2, 2, . . .). From 
the point Ag (Zo, P (7)) we draw a straight line, parallel 
to the z-axis, until it cuts the line y = т, and get a point 
By (т, (2o). 

Indeed, А Cy = Ф (£o) = B,C, since А,В. || ОС, B,C, || 
АС. But ОС, = В,С, (AOC,B, is right-angled and 


. + 





lig. 5.25 l'ig. 5.26 
isosceles since the line y =: w is the bisector of the coor- 
dinate angle). Consequently, r, = @ (0). 


We draw 4112, || OC, and, repeating the arguments 
presented above, make sure that гә = @ (шу). 

Figure 5.25 shows a convergent iterative process. The 
curve cuts the bisector y = x at the point M with abscissa 
E and, for x — E, lies under the bisector, and q (т) atis- 
lies the condition 0 << ° (2) < 1. The successive approx- 
imations x, Tys. a Cy, . . . (the common abscissas of the 
points of the graphs of the two funclions) decrease mono- 
tonically. Each successive approximation 2, is closer 
to the true value of the root than its predecessor z,_,. 
The polygonal line 4,7,4,244, . . . has the form of a 
staircase. 

In Fig. 5.26 the derivative q' (z) < 0 but is smaller 
than unity in absolute value, i.e. | Ф (ш) |< 1. The 
iterative process converges but the approximations oscil- 
late about the exact value of the root. The polygon.l 
line ABABA ... has the form c. a spiral. 

Thus, if in some neighbourhood (a, b) of the root Ё 
of the equation z = Фф (x) the derivative q' (т) retains 
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constant sign and the inequality |g (z)| xig «1 is 
satisfied, with в” (2) — 0, then the successive approxi- 
mations х, = Фф (Zn) (n—1, 2, ...), zo € la, b] con- 
verge to the root monotonically. When Ф’ (х) < 0, the 
successive approximations oscillate about the root &. 

Figure 5.27 shows a divergent iterative process. Here 
Ф (х) 21. The curve cuts the bisector y = т at the point 
М and lies above the bisector for z > Ё. 





Fig. 5.27 Fig. 5.28 


Figure 5.28 illustrates a divergent iterative process for 
the case | ф (г) | >1. The successive "approximations" 
recede from the exact value of the root &. 


Example 1. Use the method of iterations to find the root of the 
equation 5z? — 20z + 3 = 0, lying on the interval |0, 1] with 
an accuracy of 10-4. 

А We must reduce the equation to the form z = ọ (г). There are 
several ways of doing this, for instance, i 


z=2+(525—20r+3), then q,(r)—5z3— 19z-1-3, 
z= (20z—3)/5, then Ф (=) = у (20 — 3)/5, 


z= (523+ 3)/20, then gg (z) = (5z3--3)/20. 

Let us find out which of the functions obtained must be used to 
calculate the successive approximations. Recall that if ọ (z) 
satisfies the condition | 9” (х) | 9 « 1 on the interval |а, b], 
then the iterative process converges. We find that 

19; (z)| = 11522 — 19| >> 1 on 10, 1), 
{фз (z) | = 1529/20 2322/4 <1 оп |0, 1]. 
Consequently, we can use the function p, (z) and the iterative 


method to зее the successive approximations from the formula 
Za = (523, + 3)/20. We take max 9” (z) on [0, 1], i.e. т, = 0.75, 
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as the initial approximation. We employ formula (7) to find the 
difference between two successive approximations necessary for 
the specified accuracy to be achieved: 


0.0001.(1—0.75) 0.0001 .0.25 
0.75 70.75 


Thus, when the absolute value of the difference | zn — Zn- | 
does not exceed 0.00003, the iterative process must be terminated 
and the specified accuracy assumed to be achieved. 

It is convenient to use tho following table to carry out the 
calculations: 


[zn — 2-11 < —(0,00003. 











Table 5.11 
3 = 
n In | Xa 9 (xg) = ха, 
0 0.75 0.42188 0.25547 
4 0.2555 0.016777 0.154144 
2 0.4541 0.005652 0.151413 
3 0.1514 0.005443 0.151361 
4 0.15136 0.005442 0.151361 








At this stage the iterative process may be terminated and 
E =: 0.1514 шау be assumed to be the needed accuracy. Д 

Example 2. Calculate the root of the equation e* — z* — 0 
with an accuracy of e = 10-5. 

A We rewrite the equation as сх =: г? and separate the roots 
by graphical means. We construct the graphs of the functions 





Fig. 5.29 


у = ех and у = 2? (Fig. 5.29). It can be seen from the drawiug 
that the equation ех — т? — 0 has one геа! ^ot which lies on the 
interval [—0.8, —0.7]. 

Let us verify whether it is really so We find f (—0.8) and 
f (—0.7) and have / (—0.8) == 0.44933 — 0.64 = —0.19067 < 0, 
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1 (—0.7) = 0.49659 — 0.49 — 0.00659 >> 0. Since the signs of the 
function f (7) = өХ-- т? are different at the endpoints of the 
interval [--0.8, - -0.7], the root of the equation is within this 
interval. 

Let us make the interval narrower employing the trial and 
error method. We find that / (--0.75) = 0.49237 — 0.56250 < 0 
and /(—0.7) > 0. This means that the root is on the interval 
[—0.75, 0.7]. We make the interval narrower still. We have 


1 (—0.725) >> 0.48432 — 0.52562 = — 0.4130 < 0 and f (—0.7) > 
0. Consequently, the root is on the interval [— 0.725, —-0.7]. 
From the equation c* = 27 we find that х = — V o* (we take 


the minus sign before the radical since we know that the root is 
negative). We rewrite Lhe equation as т = e*/? and find out whether 
the iterative process is convergent or divergent, i.e. whether the 
inequality | Фф” (т) | « 1 is satisfied. In this example 


Фф (2) = —e*'?, q'(z) = (1/2) e*72, | ф” (—0.725) | = 0.34727, 
1%” (2) | | (—0.7) | =- 0.35230, 


Since | q^ (c) | < 1, the iterative process converges. We take 
the number q in formula (7) equal to 0.36. Since e — 10-5, it follows 
that 

0.00004 (1—0.36 
Іт — TnI < точи 080). = 0.000018. 
Thus the required accuracy will be achieved when the inequality 
| Tn — 2-1 | x 0.00002 is satisfied. We can take any one of the 
endpoints of the interval [---0.725, —0.7] and any point within 
it as the zero approximation. We assume that z, = —0.7. 
The calculations can be reduced to the following table: 


Table 512 





----------------- 











n Xn х,/2 etn! 

0 —0.7 —1.35 — (1.70460 

1 —0.70460 —0.35230 —0.70307 

2 —0.70307 —0.35154 —0,70360 

3 —0.70360 —0.3518/ — (1.703352 

4 --0.70342 —0.35171 — (1.70348 

5 — (7.70348 — 0.35174 — 0.71346 

6 —11.70346 

Since | ze — 2 | =| —0.70348 — (—0.70346) | 0.00002, the 
required accuracy of the calculations has been achieved and Ё = 
—0.7034^. A 


Example 3. Employ the iterative method to calculate the root 
of the equation z? + 322 — 3 = 0, lying on the interval [—2.75, 
— 2.5], with an accuracy of 0.001 (see Example 1 in 5.4 and Exam- 
ple 1 in 5.5). 
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A We find that f (х) -3c -| бл. Consequently, 
М, == max If! (2) | = 6.189, m, = min \/' (2)1 = 3.75, 
5] 75 1 


[-2.75, -2. 


_ AA, _ 315. 1 
scio gocl gd 


Since 4 < 1/2, we can usc formula (9) to evaluate the error. We 
assume that Мү = = 6 and then A = 1/6 and 


Фф (т) = rM (a) = z—4- (2-1-32 —3). 
The corresponding iterative process has the forin 
1 


Ing == £p — —— (th 327, — 3), 


6 
then [74,1— | = (rh 38 --3). The calculations should be 


terminate as soon as | z444 -- 1, | < е. 
We reduce the calculations to the following table: 














Table 5.13 
x 3 
т | n | `n | 5 i | de — (x9 -6 3x? - 3) 
Ш -2.5 -15.625 18.75 mE U.u2 
1 —2.92 —16.0030 19.0512 0.0880 
2 —2.5280 - 16.1559 19.1724 0.0028 
3 — 2.5318 — 16.2096 19.2148 0,0008 
4 —2.5316 
Thus we can assume E = --2.532 to be the approaima.. value 


of the root with an accuracy ar 0.001. A 


9.8. General Properties of Algebraie Equations. 
Determining the Number of Real Roots of 
an Algebraic Equation 


General properties of algebraic equations. We write 
an ath-degree algebraic equation 
Р» (2) == аул" аца) -- а„т®7®-|-... 0-а тфа, 9, (1) 
where Р, (2) is an nth-degree polynot. ‘al, n is the highest 


degree of the unknown, and ao, a), . . ., ау аге real coef- 
ficients. 
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We know that суегу number E which turns the poly- 
nomial into zero, i.e. such that P, (E) = О, is a root of 
the polynomial. 

The number Ё is a root of the polynomial Р, (г) if and 
only if P, (х) is exactly divisible by z — E. Recall that 
if P, (г) is exactly divisible by (х — &)* (k > 1), but is 
not divisible by (х — 58%), then Ё is a k-fold root (or a 
root of multiplicity k) of the polynomial Р, (г). Roots of 
multiplicity k — 1 are simple, or single, roois of a 
polynomial. 

The following theorem, which we give without proof, 
answers the question whether every polynomial has roots. 

Theorem 1 (the fundamental theorem of algebra). Every 
polynomial with any numerical coefficients whose degree 
is not lower than unity has at least one root, which is complex 
in the general case. 

There is an important corollary of this theorem: every 
polynomial Р, (x) of degree n (n >> 1) with any numerical 
coefficients -has exactly п roots, real or complex, if every 
root is reckoned as many times as is its multiplicity. 

Thus the roots of the algebraic equation (1) may be 
real as well as complex. 

The complex roots of equation (1) possess the property 
of being pairwise conjugate, i.e. if equation (1) has a com- 
plex root Ё = a + Bi (where с and В are real numbers) 
of multiplieity k, then it also has a complex root § = 
a— Ві also of multiplicity k. These roots are of the same 


absolute value: |E[ = |Ẹ | = Va? + В. 

If equation (1) has complex roots, then their number is 
even. Therefore every algebraic equation of odd degree 
with real coefficients has at least one real root. 

Before calculating the roots of an algebraic equation, 
we must: (a) determine the number of roots that equation 
has, and (b) find the domain of existence of the roots 
(establish the upper and the lower bound to the roots of 
the equation). Then we can proceed with determining the 
roots and making them accurate to a certain value. 

Determining the number of real roots of an algebraic 
equation. We can find out how many positive real roots 
the algebraic equation (1) 


P, (z) = ат” 4 аут" 4-a,2"2-+ ... Ба, 4-24 —0 
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possesses approximately, applying Descartes’ rule of 
signs: the number of positive real roots of the algebraic 
equation P, (г) — 0 with real coefficients (each of which is 
reckoned according to its degree of multiplicity) either is 
equal to the number of sign changes in the sequence of the 
coefficients of the equation P, (г) = 0 or is less than the 
number of sign changes by an even integer (the coefficients 
equal to zero are not reckoned). 

Tho number of negative roots of Ше equalion is equal 
Lo the number of sign changes in the sequence of cooeffi- 
cients of P, (—2) or is smaller by an even integer. 

If an equation is complete, then the number of its 
positive roots is equal to the number of variations of 
sign in the sequence of coefficients or is smaller by an 
even integer and the number of negalive roots is equal to 


the number of conslancies of sign or is smaller by an 
even integer. 


Example 1. Find the number of positive and negative roots of 
tho equation 25 — 1724 + 1223 -- 772 — ғ 4 1 = 


A According to the fundamental theorem of algebra, this equa- 
tion has five roots (at least one of which is real). 


The equation is complete, the sequence of signs of the coeffic- 


ients being +, —, +, 4-, =, |-. There are four sign changes and 
this means that there are either four or two positive roots or there 
аге none. 


The number of sign constancics is 1, and, consequently, the 
equation has one negative root. 


Example 2, Find the number of positive and negative res! roots 
of the equation 1%-- З=! -- z? -j- 32 — 1 = 


^ This equation has six roots; the sequence ofsignsis , —, 
+, —. There aro three sign changes, and, consequently, there are 


either ‘three positive roots or there is one root. Furthermore, for 
the polynomial 


Pa (—z) = zf — 3x4 — 1? -|- 3-1 


the sequence of signs із +, —, —, |. --. We also have three changes 


of sign here and, therefore, there are either three negative roots 
or one. À 


Sturm's theorem allows us to һе more precise in deter- 
mining the number of roots of an algebraic equation. 


Since we can always separate the multiple rools of en 
equation and the common roots of the .qualions Р, (т) = 
0 and Р, (х) = 0, we can assume without loosing gene- 
rality that the equation P, (г) = 0 has only simple roots. 


15--0104 
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Suppose we have established in some way that all the 
real roots of the algebraic equation P, (z) = 0 are in Ше 
interval (a, b) (а and b are real numbers and аге not roots 
of the equation, a < b). We [ind the first derivative 
Р» (г) and divide the polynomial P, (т) by it. We take 
Ше remainder of the division of Р, (x) by P; (г) with the 
opposite sign and denote it by Л, (т). 

Then we similarly divide P; (г) by R, (г), take the 
re:nainder obtained with the opposile sign and denote iL 
by R, (х). Dividing Л, (х) by R, (г) aud again taking 
the remainder with the opposite sign, we get R, (х). We 
continue the process of division until we get a remainder 
which is a constant quantity. We take that quantity also 
with the opposite sign. 

The result is a sequence of functions 


n (2), Р, (х), Ri (2), Ra (2), ..., Rm- (2), 
Rm = const, 


which is known as Sturm’s system. We substitute first a 
and then 6 for z in this sequence and count the number of 
sign changes in both cases [we designate the numbers 
obtained as W (а) and W (b) respectively]. 

Theorem 2 (Sturm's theorem). If the real numbers a 
and b (a < b) are not roots of the polynomial Р, (x), which 
does not have multiple roots, then W (a) > W (b) and the 
difference W (a) — W (b) is equal to the 1 number of real 
roots of the polynomial Р, (г) which lie between а and b. 

Sturm's theorem can be utilized to (ind the number of 
negative roots of tlie equation P, (г) = 0 [i.e. the num- 
ber of real roots of the equation P, (х) = 0 in the interval 
(—oo, 0)] or the number of positive roots [in the interval 
(0, --oo)) Sturm's theorem is also used to separate 
roots. The functions entering into Sturm's system can be 
multiplied and divided by arbitrary positive numbers. 
This simplifies the calculations considerably when divi- 
sion with a remainder is carried out. 


Example 3. Find the number of real roots of the equation 523 — 
20z + 3 = 0, and also separate those roots utilizing Sturm's 
theorem. 

A We set up a system of Sturm's functions. We have P, (г) = 
5z? — 20z + 3, Pi (z) = 1523 — 20. To determine R, (2), we 
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multiply P, (г) by 3 and then divide it by Pj (2): 


І 
1523—20 | 1543--60:--9 
+1523 + 20z 
— mn 
Henco R, (2) = 40r — 9 (the remainder is taken with the 
оррозііе sign). We multiply Р» (z) by 8 and divide the product by 
3z 4-21 
40z—9|  1202:2—160 | 
1202? + 27: 
7-7 0 (272 — 160) 
40-27z — 40-160 
-FAU-21z + 9.27 


Since tho last remainder is a constant quantity with the minus 
sign (and in this case we are interested particularly in the sign 
of the remainder), we change it to the opposite, i.e. to the plus 
sign. 

We compile the following table of tho signs of the functions 
which enter into Sturm's system: 

















x Рр (х) | ri) m (х) Ra wor 
о - + - + 3 

0 + - - + 2 
+ + + + + 0 


We can see from the table that there are three real roots in the 
interval (—oo, 4-co) [since W (—оо) — W (о) = 3 — 0 = 3]. 
One of them is negative |W (—oo) — W(., = 3 — 2 = 1] and 
two are positive [W (0) — W (+œ) 22 — 0 = 2]. 

Utilizing Sturm's theorem, we separate the roots diminishing 
the intervais to the length equal to unity: 


15% 
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z Pp (х) Рх) | Ry (х) Rs (x) | W (x) 
— oo — + — + 8 
-3 - + - + 3 
-2 + + - + | 2 
-4 + — + T 2 

+ - - + 2 

1] c - + + | 4 

2 + + + + 0 


We can see from this table that the roots lie in the intervals 
(—3, —2), (0, 1) and (1, 2. A 


5.9. Finding the Domains of Existence of the Roots 
of an Algebraic Equation 

Rule of annulus. Assume that we have an algebraic 
equation | 

Р» (г) = аы" + az”! dau +... 4+ Apt 

+ аһ = 0, 

where а, а ..., аһ are real coefficients, and let А = 
max {| а; |, laal ..., |а, |}, B = max (|а) |, la |, 





Fig. 5.30 


2... |4,-а |}. Then the roots of the equation are in the 
annulus r < | z |< R, where 


{ 2p. A 
г= тваі В тат" 


Неге г is the lower bound and А із the upper bound of the 
positive roots of the algebraic equation P, (2) — 0 and 
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—H, —r are the lower and the upper bound of the negative 
roots respectively (Fig. 5.30). 


Example 1. Determine the bounds of the roots of the equation 
5z? — 20z + 3 = 0. 
A Here|ag| 25, А--20, |а„|=3, В--20, ie. 


A 20 
Н-1-- Т =1+-к-=5; 


NJ 


4 
—— — 0.0 
—FBAHa. = 1913 “оз 504043. 


Г-- 


Then, if the real roots of the equation 523 — 20z + 3 = 0 exist 
(and they are sure to exist since the equation is of an odd degree), 
they lie in the interval (.-5, 5), the negative roots lying in the 
interval (—5, --0.013) and the positive roots in the ínterval 
(0.013, 5). A 


When solving equations, it is convenient first to estab- 
lish the bounds of the roots and then use Sturm's theorem. 
The rule of annulus makes it possible to find the approxi- 
mate bounds of the roots. 

The technique given below allows a more precise esti- 
mation of the bounds of the real roots of the algebraic equa- 
tion P, (z) — O. 

If В, is the upper hound of the positive roots of 
Р» (х), R, is the upper hound of the positive roots of 
P, (—z), R, 2 0 is the upper bound of the positive roots 
of z"P, (1/r) and R, is the upper hound of the positive 
roots of z^P, (—1/z), then all the nonzero real ,.› ts of 
the equation P, (х) = 0 (if they exist) lie wit}... the 
intervals (—R,, —1/R,) and (1/2, Hy). 

To find the upper bound of the positive rocts of an 
algebraic equation, we can make use of Lagrange's or 
Newton's method. 

Lagrange's method. If the coefficients of the polynomial 


Р(х) > ау" а аут? ... a, 


satisfy the conditions ay 7» 0, a4, а, ..., dmi > 0, 
а, < 0, then the upper bound of the positive roots of the 
equation P, (х) = 0 can be found fren the formula R = 
1 + Bla,, where B is the greatest of the absolute values of 
the negative coefficients of P, (т). 
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Example 2. Use Lagrange's method to determine the bounds 
of the positive and negative roots of the equation 8z* — 8z3 — 
32z + 1 = 0. 

A Here a, = 8 > 0, а, = 0, a, = —8 < 0, ау = —32, а, = 
1, m = 2 (the number of the first negative coefficient), B= 2432. 
Consequently, В, = 1 + 32/8 = 3. 

Let us consider tho polynomial 


Pa (—х) = 8z* — 87? + 32x + 1. 


We find by analogy that the upper bound ol its positive roots is 
R, = 1+ V8/8 = 2. 


Furthermore, for the polynomial 
ТАР, (4/2) = 24 — 3253 — 822 +- 8 


we have a, = 1 > 0, a, = —32 < 0, io. m = 1, В = 32, Ry = 
1 + 32 = 33. 
And for the polynomial 


ЖАР, (—1/z) = т^ + 3223 — 8r? -+ 8 


we have ay = 12» 0, a, = 32, a, = -8, аз = 0, a, = 8, i.c. 

m = 2. Therefore, А, = 1 + V8 = 1 + 2V 2 = 3.828. 
Consequently, if the equation 824 — 873 — 32z + 1 == 0 has 

real roots, they are sure to lie in the intervals (—2, —1/3.828) and 


(1/33, 3). А 





Newton's method. 7f for x == ¢ the polynomial 
P, (х) = ау" |. аа"... + a, 


and its derivatives Ph (т) and Ру, (х), . . . assume positive 
values, then c is the upper bound of the positive roots of 
the equation P, (x) = 0. 


Example 3. Use Nowton's method to determino the upper hound 
of the positive roots of the equation 814 — 8z? —- 32z + 1 
A We find that 


Р (=) = 824 — 8z? — 32z + 1, P’ (т) = 3213 — 162 — 32, 
P” (z) = 9622 — 16, Р” (г) = 192z, РІУ(г) = 192. 


We must verify the values of z > 0. For z = с = 1 we have 
P (1) < 0. This means that we may not continue the verification 
for z = 1 Let us verify the value z = c = 2: P (2) > 0, P’ (2) > 
0, Р" (2) > 0, P” (2) > 0, Р!(2) > 0. Thus the number 2, 
i.e. R = 2, is the upper bound of the positive roots. We can take 
the inverse of the number R, i.e. ғ = 1/2, as the lower bound. A 
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5.10. Horner's Method of Approximating Real Roots 
of an Algebraie Equation 


Consider an algebraic equation 
P (1) = z” -|- ayz™ аза"? р... -Han =0, (1) 


where а), аҙ,..., а, are real coefficients of the polyno- 
mial. We have to find the real roots of this equation. 

We represent the required root of the equation, written 
in the decimal notation, in the form 


X =c 107 4- c,- 10771 4- e,- 10772 4- 
‚ be, 10775 4... 


Horner’s method consists in the successive delermi- 
nation of the digits of the rool cy, с), ... by means of 
special transformations of equation (1). 

If we empivy the substitution zr = 107$ (for са >0) 
or x = —107€ (for с, < 0), then we reduce equation 
(1) to an equation 


f, (E) - E^ 4 a E" age... +a, =0, 


whose root is in the interval (0, 10). Therefore, in what 
follows we shall consider this particular case. This sim- 
plifies the process of computation of the root although it 
is not obligatory for the employment of Horner’s method. 

Since 0 < X < 10, the root of equation (1) “en be 
written in the form 


X see NE A d ud 


435 ^ 308 5405 Кс 0066 -- 


It is easy to find the first digit са of the root either by 
the table method or by the use of the interval [a, b] of 
separation of tho root. 

Next, applying the transformation 


І —су,=}у (2) 


to equation (1), we find that т = y | со, whenco it ful- 
lows that 


Р (г) = P (у + со) = —9(y) = 0. (3) 
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The number y = 0, cc,c, ... is evidently the root of 
the last equation. Applying the substitution 


y = Ү/10 (4) 
to equation (3), we arrive at an equation 
P, (Y) = 0, (3) 


whese root is Y = 10у = сус, .... Equation (37) 
yields the digit c, which is the second digit of the root 
of equation (1). Then we can again apply substitutions 
of types (2) aud (4), but this time to equation (37. Asa 
result we get an equalion 


P, (Z) = 0, 65) 


whose root is the number 2 = с, C} .... Then we find 
the digit c}. 

This procedure can be repeated until we get the required 
number of digits. Ногпег'ѕ method can be used іп com- 
bination with some other method, say, the chord method, 
Newton’s method, or the combination of these two meth- 
ods. We first find several digits of the root by Horncr’s 
method and then use other methods to make a closer 
approximation. 07 

When we have to obtain a small number of the digits 
of the root, we can use the following technique. 

If one of the roots of the equation is considerably smal- 
ler than the other roots, then it can be approximately 
calculated by means of the division of the constant term, 
taken with the minus sign, by the coefficient of the first 
power of z. 

How can substitutions (2) and (4) be carried out in 
practice? 

To make substitution (4), we must multiply the coef- 
ficients ау, аҙ,..., а, of the initial equation by 10, 107, 
105, .. , 107 respectively. 

Substitution (2) must be preceded by the expansion of 
the polynomial?P (т) in the powers of т — c,, for which 
purpose we can use either Taylor's formula or the fol- 
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lowing relations: 


Р (х) = q (т) (£ — co) + ro, 
qı (4) = qz (2) (т — co) -+ гу, 
Ф (т) = 93 (zx) (£ — co) + rs. (6) 


In-2 (г) = fn- (т) (т — б) -F Frogs 
Gn-1 (т) = (z — €) -F Гл-1› 


where q; (x) and ғ, are, respectively, the quotient and 
the remainder of the division of 4; (2) by (z—c,). Suc- 
cessively eliminating q, (r) from relations (6), we arrive 
at an identity 


Р (х) = (£ — со)" Eríaí(r—ce)? 

F lig (E — c9? +... d ra (E со) 4 го, (7) 
i.c. obtain an expansion of f (т) in the powers of z — c,. 
Horner's scheme can be used to calculate each of the 
remainders r; (i = 0, 1,..., п — 1), i.e. the coefficients 


of the expansion. 
The system of equalities (6) corresponds to the table 








со 
1 а; а, a, ee an-ı an 
1 bi b, by bn. To 
1 еі е, е1 ... Ti 
1 Ғһ-і 
where бу = dic, by = bey, Ву = бус, ..., Oy = 1. 
е, = eCo Cy = 656... IF the coefücient of z^ is а, 


then we must write ау rather than unity in the first 
column. 

Example. Use Horner’s method to find the smallest root of the 
equation z? + 3:2 — 3 = 0 with six significant digits. The roots 
of the equation have been separated and the smallest of them is 


on the interval [—3, —2] . 
A (1) Since the root is negative, we transform the original 


equation by means of the substitution z : —z: 


уз р 38 3 = 0, or 2—3243-90. 
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The required root of the equation z € [2, 3]. Consequently, the 
first digit of the transformed equation is 2. Then substitutions (2) 


and (4) have the form 7 — 2 — y and y — Y/10. We use IIorner's 
scheme to make the first substitution: 





ey —2 
1 —3 0 3 
1 -4 -2 [27] 
1 1 [0] 
(| Gl 


According to formula (7), we find from this table that ф (y) — 
уз + Зу — 1 and P, (Y) = Y? -|- 30Ү? — 1000 = 0. 

In what follows, we can use the table to write the two trans- 
formations together, retaining the designation of y, i.c. instead of 


the last relation we shall write P, (y) — y + 30? — 1000 -- 0. 
We shall find the values of the polynomial P, (y) for certain 
values of y 610, 10] using Horner's scheme: 








y | 1 | 30 | 0 | —1000 
5 | 1 | 35 | 175 | —125 
G | 1 | | 36 | эв | 295 


Since P, (5) < 0 and P, (6) > 0, it follows that y € [5, 6]. Hence 
сү == 5. 

! (2) To find thenext digit, wo set up ап equation whose coeffic- 
ients are obtained [rom Horner's scheme, employing substitution 
(2) and (4) for c, = 5: 


C= 5 
1 30 0 — 1000 
1 35 175 | 7125) 
1 


ю | [35] 


Thus P, (у) = y? + 450y? + 37 500y — 125 000 = 0. 
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We seek the values of P, (y) for certain values of y € [0, 10] 
using Horner's scheme: 





y | 1 | 450 | 37 500 | — 125 000 
3 | 1 | 453 | 38 859 —8 423 
4 | 1 | 454 | | 39 316 | 32 264 


Since Р, (3) << 0 and P, (4) > 0, it follows that y € [3, 41. [lence 
са = 3. 

° (3) We derive an equation for determining the next digits 
whose coefficients can be found from Horner's scheme: 








c,=3 
1 A50 37 500 — 125.000 
1 453 38 859 [8423] 
ЖЕБЕ ПЕ 
1 | [ 459] 








Hence P, (у) = y? -|- 4590g? +- 4 022 700у -- 8 423 000 = 0. 

We can apply a special technique described above to the equa- 
tion obtained. As а result of a three-fold substitution (4), all the 
roots, except for the required one, have increased approximately 
10? times. Then the root of the last equation is approximatoly equal 
to 8 423 000/4 022 700 ~ 2.09. This means that the digits 2, 0 
and 9 are the next decimal digits of the root of the original equation. 
As a result we find tho root of the given equation, it is X — 
-—2.53209. A 


Exercises 


1. Use analytical means to separate the roots and calculate 
them with an accuracy of 0.001. Employ the trial and error method. 
(а) і3-:--1--0, (Ь) °25 -|- 22 -4--0, (с) гї -|- 52 — 3 = 0, 
(d) 2.22 — 25 -= 0, (e) 25 -- 2r? — 1 -: 0, (f 2х — år = 0. 

2. Use graphical means to separate the roots and calculate 
them with an accuracy"of 0.001. Employ the chord 1nethod: 

(а) 12--:--3--0, (hb) 134 8: —6.-0, (c) r?-- 102 — 9 — 0, 


(d) z? — cos nz = 0, (c) z? — sin лг = 0, (f) logz -4 = 0. 
3. Use Newton's method to find the roots of the following 


equations with an accuracy of 0.001: 
(а) z3 — 6z? + 9z — 3 = 0, (Ь) т3-- 122 --8 = 0, 


(с) z3 -H 4s — 6 = 0, (d)2logz — -+1 = 0, 


(е) х2 — 20 sin z = 0, (f) z-— созт = 0, 
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4. Use the combination of the chord method and Newton's 
mothod to find the roots of the following equations with an accuracy 
of 0.001: 

(a) 23-- бх — 5 = 0, (b) =? — 25 + 7 — 0, 
(с) 23 — 2:2 + = + 1 = 0, 


(d) 1.822 — зіп 10: = 0, (е) log = — 


(f 2zinz — 1 = 0. 

5. Employing Sturm's theorem, separate the roots of the equa- 
tions and calculate them with an accuracy of 0.001 using the itera- 
tive method: 

(А) а2--4г-38--0, (b) ef — 2r — 1 = 0, 

(с) 35 — 5r + 2 = 0, (d) ż+z—3=0. 

6. Use the iterative method to find the roots of the following 
equations with an accuracy of 0.001: 

(a) In z + (z +1) = 0, (b) Vz-r1-—1/z (с) z— cosz = 0, 
(d) З= — cos z — 1 = 0, (е) = + log z = 0.5, 


7 
224-6 0, 


Chapter 6 


The Eigenvalues and 
Eigenvectors of a Matrix 


6.1. The Characteristic Polynoinial 


Consider a square matrix Я and a nonzero column 
vector x: 


zi 

411 042... аң т 

А- Gq, gq... Aon __ 3 

Ud ...,... , Х- : 
„пі Спз... Опр 

Та 


Multiplying the matrix A by the vector x, we obtain a 


column vector 
Уі 
уа 
у= : 
Yn 


y = Ах. (1) 

If the coordinates y, (i = 1, 2,..., n) of the v- tor y 

prove to be proportional to the respective coordinates т; 

of the vector x, with the proportionality factcr А, i.e. 
if y, = Мм, and, consequently. 


y = Ax, (2) 


then the nonzero column vector x is an eigenvector of the 
matrix A and the proportionality factor А is an eigenvalue 
(or characteristic value) of the matrix A. Since y = Ах 
and y — Àx, it evidently follows that 


Ax = Ах. (3) 
Thus, if condition (3) is fulfilled, then the vector x is 


the eigenvector of the matrix A corresponding to its 
eigenvalue À. 


i.e. 
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Example 1. Assume that 


a ij “ІҢ, 
“И [HH] 


Consequently, the number А = 6 із an eigenvalue of the matrix А 
since equality (3) is satisfied: 


17 
Ах=лх=6 {1 |, 
1 


1 

and the vector x= p is an eigenvector of the matrix А corre- 
1 

sponding to the eigenvalue 4=6. 


We rewrite relation (3) in the form Ax — Ах = 0, or 
(A —M) x = 0, (4) 


where / is an identity matrix of the same dimension as 
the matrix A and 0 is a zero column vector. It is evident 
that without the factor / in the product М, equation (4) 
would be meaningless. 


Then 


Since 
0 
00...09 0 
0Х0.,.4 
М = Bor os). |, 
000... А ` 
0 
we can write equation (4) аз 
Zi 0 
слу —À ау; +++ Un 0 
T2 
421 092 — ^ ... Gan of]. (5) 
апі Ong  ...Unn—À za 0 


Relation (5) is a homogeneous linear system of equa- 
tions which has nonzero solutions if and only if its deter- 
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minant is zero, i.e. when the condition 
det (A -М)--0 (6) 


is fulfilled. 

Equation (б) is a characteristic equation of the matrix A 
and its left-hand side is a characteristic polynomial (or 
characteristic determinant) of the matrix A. 

We can also write out the characteristic equation as 
follows: 


411--À ау tes in 
Go) азо — À ... бол _ 0 (7) 
апі апа апп —^ 


If we ex pand the determinant on the left-hand side of 
equation (7). we gel a polynomial of the nth degree with 
respect to A: 


D (А) = det (A — Al) 
= (ЧА pA --2-p,A7? — ...--(—41)^ pa]. (8) 


The quantity А, found from equation (8), assumes n 
values A,, Ag, . . ., An, among which equal values may be 
found. To find the cigenvectors x, which correspond to 
the eigenvalues А; (i = 1, 2, ..., н), we must solve the 
homogeneous linear system of equations (5) for each 


value A;. 


Example 2. lind the eigenvalues and eigenvectors of һе ma- 


. 21 
trix A— [; 21 . 
A (1) We write the characteristic polynomial of the matrix A 
and find 4. We have 
2—1 
1 


The characteristic equation A? — 4А + З = 0 has two roots А, = 1 
and A, = 3, which are the cigenvalues of the matrix A. 





1 —à3-— 
|+. 


(2) Wo seek the eigenvector x(D— (51 corresponding to the 
a- 


value 4; —1. The matrix equation 


(4-м 3070, or [^ aa] МЫП 
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: =0 . . 
is equivalent to the system { ndn- ; Which has an infinite 
тү-т„=0 
number of solutions of the form z,— —z,. Setting z,--c (с is 


any number), we get == —c. Then the required eigenvector can 


—1 
(3) We seek the eigenvector x(2) = [2] corresponding to the 


be written as x( —c [ 


second eigenvalue А, = 3. We have 


2—3 1 “т 03 
— 3) — l|. 
(A— à) X 20, or | 1 2—3 | |81-(р . 


— 11 +Hr=l 
zi —zrz$3420" 

whence it follows that =, = z4. Setting z; =c, we find that == c. 

This means that the second eigenvector has the form х(2)-- 


ЫРА 

When eigenvalues and eigenvectors of matrices аге 
sought one of the following two problems must be solved: 
(1) all the eigenvalues and the corresponding eigenvectors 
of the matrices must be found, or (2) one or several eigon- 
values and the corresponding eigenvectors must be 
determined. 

The first problem consists in expanding the characteris- 
tic determinant in an nth-degree polynomial (i.e. in 
finding the coefficients рі, р», .. ., Pn) and calculating 
the eigenvalues М, 44, . . ., An and, finally, finding the 
coordinates of the eigenvector xT = (£j, Za}, .... 24). 

The second problem consists in finding the eigenvalues А 
(one or several of them) using the ilerative methods, 
without expanding the characteristic determinant. 

The methods of the first problem are exact, i.c. if we 
apply them to matrices whose elements are defined oxact- 
ly (by rational numbers) and carry out precise calcula- 
tions (according to the laws of operations involving com- 
mon fractions), we shall get the exact values of the coeffic- 
ients of the characteristic polynomial and the coordinates 
of the eigenvectors will be expressed by exact formulas 
in terms of the cigenvalues. 

The eigenvectors of a matrix can usually be determined 
with the use of the intermediate results of the computa- 
tions carried out to find the coefficients of the characteris- 


This matrix equation leads to the system { 
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tic polynomial. It stands to reason that to find an 
eigenvector corresponding to a certain eigenvalue, this 
eigenvalue must be already calculaled. 

The methods of solving the second problem are iterative, 
i.c. the eigenvalues are obtained here as the limit of some 
number sequences as well as the coordinates of the eigen- 
vectors corresponding to them. Since these methods do 
not require the calculation of the coefficients of the 
characteristic polynomial, they are less labour-consuming. 
Іп what follows we consider some methods of expanding 
a characteristic determinant and the iterative methods 
of finding the eigenvalues of a matrix. 


6.2. The Method of Direct Expansion 


Let us consider a third-order matrix in order to under- 
sland how the coefficients of a characteristic polynomial 
сап be fou, .t hy a direct expansion of a characteristic 
determinant. Let 


411 ау; 413 ау 4144 913 
А. [21 a22 023 |, det (А —Al)-- dey 033 — À tag 
ау Q32 033 4з Аҙ? 434 — А 





We use the rule of triangle to calculate the determi- 
папі: 





431 -А aig diz 
det (A — AI) — | 421 022 — № азу 
031 Q32 d33 — h 





— (а — A) (95, — A) (a33 — A) -F 415053031 + 24503545, 
— 04403, (4 — A) — аа, (азз — A) — 25543; (а— A) 
---АЗ| M (a4 4-05, + 233) — ^ (аа — 212051) 
4- (92033 — 653033) -F (04,033 — 043031) + (011053033 + 013053051 


+ 443034 ,, — 41303505; — 0,505,033 — 053035044 


411 412 








к= (— «peas (4; + aza -t аа) + А ( азу 492 


)- |. 


det (A М) = (—1)# (A? — руд? + p — pa) = 0. 
106-0104 


Q4, ау; ауу 


а4а 
11018 азі 422 азу 


031 033 


23 033 
039 33 

















аз 292 033 
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The coefficient p, here is the sum ol the diagonal elements 
of the matrix A. It is known as the trace of the matrix 
and is designated as Tr A: 


= Tr A = ay, + а, -F aag; 


the coefficient p, is the sum of all the principal minors of 
the second order of the matrix A: 


411 41 
031 439 


Q22 42 
032 033 


411 Gyo) |. 
421 422 




















Ро == 


(recall that the principal minors of Ше second, the 
third, ... the nth order are minors the elements of whose 
principal diagonals are the elemenis of the principal 
diagonal of the determinant det A); the coefficient 


441 012 Gig 
P= det A= 


421 49; 42; 
431 032 033 








In general, we have Lo expand the determinant det (A — 
М) in an nth-degree polynomial 


D (A) = — (1 [A^ — pA" + pA? — ... E (— 1)" Pn) 
then the coefficients pj, py, ..., Pn can he found from 
the following formulas: 

p аң = Tr A which is the sum of all the dia- 


gonal elements of the matrix А, 


P; = У 
< 


cipal minors of the second order of the matrix A, 


Рз = уу 


ас pev 


ада taf 


which is the sum of all the prin- 
“Ba Ap 








ассо, Cop Gay 
apa app apy 
Gya Gypa ayy 
principal minors of the third order of the matrix A. 


which is the sum of all the 


a 








Pa = det A which is the determinant of the matrix A. 


The number of principa! minors of order k of the mal- 
rix Á is 
(1) ne (0-2). (RED) р. фо 


М id <.. һ). 
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The method of direct expansion is very labour-con- 
suming and is only used to find the characteristic poly- 
nomials for low-order matrices. 


Example 1. Use the method of direct expansion to find the char- 
acteristic polynomial of the matrix 
7-4 —3 1 1 
2 0 4 —1 
1 1 2 —2 |: 
1 1 —1 —1 


А- 


(1) We find that 
Py = Tr А = ayy + 05 +F аза + 244 = —4d3-04-2—1—--8. 











(2 We have p,— > “ао 098. The number of second-order 
a ара авв 
"M : „о fá 4-3 
principal minors of a fourth-order matrix is (2) = 27 =6. 
Writing out ali these minors and adding them PA we get 
- - 1 
n-| ^2 "eH I) 4 н; КЕТИ 
22 ZL 
a=1; В-2 a=1; “ауыз а--1; керген a—2; В=3 
0—1 2 —2 
Hd zi Із -а 11277 
— — 
а--2, В--4 а--3; В--4 


ада laß Fay 
ава app apy 
aya yp ауу 


(3) We have ps= 2 
a<p<y 4 
third-order principal minors of a fourth-order matrix is (3) = 
4.3.2 


The number о! 








= 4, Consequently, 


























1.2.3 

—4 —3 1 —4 —3 1 --4 1 1 
p=] 2 04|4| 2 o—1l+H 41 2 2 
1 12 1 1 —1 1 —1 —1 
Nem mm^ ——— —— 
a=1; B—2; y—-3 a=1; В--2; y—4 &—1; В--3; y-4 

0 4 —1 

-H14 2 —2 |=24. 
1 —1 —1 
—— 


a=2; B3; y—4 
10* 
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(4) And finally we find that 


-4-3 1 1 
2 0 4-4 

Pa=detA=| 4 4 9 о |= —15. 
1 4-1 --4 


(5) The final result is 
D (A) = M — р + рз? — pah -H pa 
= M + ЗАЗ — 708 — 244 — 15. A 


Example 2. Expand the characteristic polynomial of the matrix 


з 1 O0 
А=|—4 —1 | 
4 —8 —2 


and find any of the eigenvalues and the corresponding eigenvector. 
A (1) We have 


һ-1ғ4-2-1-2-4 














ЕЕЕ Е 
Ра > ара авв =|; —1 ur 4 —2 + —8 оз 
acp —$ a —„— —Ó— 
=1; В? а=1; В:=3 а-:2; B-—3 
--1--6--2----3; 
3 1 0 
- pg—detA—|—4—1 0|=—2 
4 —8 —2 
Consequently, D (А) = (—1)? (13 — 3A Т 2), — 84 + 2 = 0. One 


of the eigenvalues of the matrix A із А — 
(2) Let us find the eigenvector x — |: 1. corresponding to А — 1. 
The matrix equation 
3-1 1 0 гу 0 
(А— М) х= 0, or | —4 —1—1 0 г, |: [0 
4 — 8 —2—1 тз 0 


is equivalent to the system 


2т\-+ 2, =0, 
{ —4Az,— 2r, =0, 
Az, — 82, — 3234 = 0. 
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The first and the second equations are proportional here and, 
therefore, discarding the second equation, we get a system 


22, 4-24 =0, 
471--8т,-3гҙ-- 0. 


Тһе шїпог а= | 4 —8 
аге base unknowns, ту is a free unknown. Using then Cramer's rule, 
we find that 





= — 2i) is a base minor, т, and z, 


"EHE 











Td 2291 20" 
2 0 
__ d, _ |4 3z | бі; 
а^ —3) "^ —2° 


3 
Setting z4— 20, we find that z, =3, z, — —6. Thus x0) = е El 

2n 
is the required eigenvector. A 


6.3. Krylov's Method of Expansion of a Characteristic 
Determinant 


Krylov's method is based on the properly of a square 
matrix to turn its characteristic polynomial into 
zero. 

According 1o the Hamilton-Cayley theorem, every 
square matrir is a root of its characteristic polynomial 
and, consequently, iurns it into zero. 

Let 


D (А) = det (A — AI) 
—(— 1)" Q^ ру" + pak"? +... + ра) (1) 
be a characteristic polynomial of the matrix A. Replacing 


the quantity A in relation (1) by A = [a,j] (where i = 1, 
2,...,n,] —4,3,..., n), we obtain 


A? + p, A71 p A772 4- ... + pal = 0. (2) 
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We take an arbitrary nonzero vector 
yo 


(0) 
y 


yout]: (3) 
y 
and postmultiply both sides of relation (2) by y: 
AYO + p, A719 + p, A")... pay=0. (4) 
Now we set 
Ау®-0 — y (K — 1, 2, ..., п), (5) 
i.e. 
y? = Ay, 
y? — Ayo = Ary, 


Then relation (4) assumes the form 


y? + Py) + poy?) +... Pry =0, (6) 


or 
Py + py 4... + Pry = —y™, 
or 
yr ye 
үре» үре 
Pi : + Pa : + 
үт-ө yp? 
ye um 
y; yy 
‚+ Pn : — — : , 


ye ye 
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1.0. 
Pay? + pay? +... + pny? = — и", 
pis? | pay -H Ls. b pay? = — yy (7) 
Pig + pay D +... + pay? = — yit 
or, finally, in matrix form 
(n) 
/п-9 yfn-m |) y(? Рі и" 
yp yg- s yo Pe yy 
DN ". : PST]: (8) 
т-і) ,(n-2) (0) И ° 
un? уп ‚и Ей уро 
The vectors yj", yi?, ..., yf" can be found from the 
formulas 
т 
у? = У ауу)” = Ay, 
y= 
т 
( 
у? = 2. ау)" = Ay, (9) 
т 
у=} ануу” = Ay (1-1,2, ...) а), 
J= 


the coordinates of the initial vector (3) being arbitrary. 
If the linear system (7) has a unique solution, then its 


TOOLS Py, Po, . . ., Pn аге thec 
tic polynomial (1). 


find this solution. 


Example 1. Use Krylov’s method to 


determinant of the matrix 


A= 


A (1) We choose an initial 


We can 


—4 —3 1 
2 0 A 
11 2 
1 1—1 


oeflicients of Lhe charecteris- 
use Gauss’ elimination to 


expand the characteristic 


1 
—1 
—2 
—1 


vector y0) = 


a 


Do э 
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Table 6.1 
Constant 
Ті p2 ра | Pa terms | zi 
—39 12 -4 1 — 420 —150 
230| —5 2 0 47 64 
11| —2 1 0 23 33 
13| —4 1 0 43 53 
1 | (| -мз] um | из] ons |o 4/39 -us | 40/13 | 50/13 |o 
[15/13 || —2/39 | 20/39 | —189/43 —108/43 |— 168/13 
18/13 | —5/39 | 11/39 | —141/13 —12143 |-121/13 
0 |—1/3 | —14/3 3 3 3 
| 1 -ans | 4/9 | —53/5 | — 56/5 | -ses 
[7145]. —1/3 33/5 31/5 31/5 
—4/3 1/3 3 3 3 
| | 1 | 5 | —99 | —93 | —93 
| | || | |= 
| | | 1 | —15 | —14 | —14 
| 1 Pa=—15 | ра= — 14 —14 
1 рз= —24 | p= —23 — 23 
1 Po=—7 |Р--б —6 
1 pi-—3 P= 4 
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(2) Using formulas (9), we determine the coordinates of the 
vectors y(&) = Ay(-D (k = 1, 2, 3, 4): 


—4 —3 1 1771 —4 
2 0 4 -i a 2 
у0)-= 4у0=| 1 , 5 қ ME 
4 4-1 0 1 
—4 —3 1 1 —4 12 
у(2) = Ay) = 2 0 4 2|_| -5 , 
1 1 2 1 —2 
1 1 —4 1 --4. 
—4 —3 1 j 12 —89 
0 4 — —5 20 
уо) -= Луб) -= 1 1 2 --2 11 , 
1 1-4 {| —4 13 
—4 -3 1 --39 120 
2 0 4 2) — 47 
YO= AY =] 4 4 2 u|^|-z[ 
1 1 —1 13 —43 


(3) Then we set up a matrix equation 


—39 42-411Гр 12) 
20—5 20 Po --47 
8-2 10||5nl ^ |-23 
13-4 1404 Lp. —43 


and write a system of form (7): 
— 39p, -|- 12p, --4pa + p, = — 120, 
20р, — ӛр, -2ра-- 47, 
11p1— 2Pa t Ра-- 23, 
13р; — 4pe+ ра = 43. 


We solve this system using Gauss' elimination (see Table 6.1). 
Thus we have 
D (А) = det (A -- AI) = А -H p4À3 + pad? + ps + р, 
= q- ЗАЗ — ТАЗ — 24À — 15. А 


Now if the linear system (7) does not have a unique 
solution, the initial vector must be altered. 
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Example 2. Use Krylov's method to expand the characteristic 
determinant of the matrix 


1-1-1 2 
2 3 0 —4 
A=] 4 —2-2[ 
1 1 0 —1 
1 
0 
^ (4) We take у — о | as the initial vector and obtain 
0 
1 0 
yO) = Ay = 2 уб) = Ay) = 4 ; 
1 2 
1 —1 
4 6 
y9—-A4yn-|5,|; x9—4y9—-| 4 
! 2 3 


(2) We set up a matrix equation 


4 041 p 1 
4 420 Pa 6 
2 —110 в| 1-—3]' 
2 210 Ps 3 


whence we obtain a system of equations 


Pit Pat pac1, 
4p; +4p,+ 2p3 — — 6, 
2pi-— Pot P3=3, 
2pıt 2P t рэ == —3. 


We solve this system using the scheme of unique division (see 
Table 6.2). 

Since the pivot element is zero, it is impossible to continue the 
calculations using this schemo. 


(3) To obtain the unique solution, we change the initial veç- 
-0- 
0 
tor. Setting y= p we find that 
Lad 
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2 6 
—4 4 
yQ) = Ay = -26 y) = Ay(0 = 41: 
—1 1 
4 
4 8 
yd = Ay(0 = -4| yO= Ay@) = 10 |- 
3 
The matrix equation 
4 6 2 0 рі 10 
4 —4 — 4 0 P| |8 
—4 A4 —20|[|npg| 10 
3 —1 —1 14 Lp,- 5 
Table 6.2 
Constant 
ті рз P3 ра terms 21 
[1] 0 1 1 1 4 
5 5 2 0 —6 5 
2 —1 1 0 3 5 
2 2 1 0 —3 2 
1 0 1 1 1 4 











—1 -1 -2 4 -3 
2 -4 —2 -5 -6 
-І,5 —1 —8 3.5 
—1.5 —3 —2 -6.5 —6.5 
0 0 1 1 1 
1 2 1.333 4.333 | 4.333 


E E 
didi 
EIEININIM 
Halaas 
sepa a [ls 
кы 
EENI 
81 





252 Computational Mathematics 


leads to the system 

















Api-6pi 2p,  =—1' 
4p, — 4p, —áps = — 8, 
—4p1+ Áps — 2p, = — 10 
3pi— ра — рз ра = — 5, 
or 
2рі--Зр, + Ps = —5, 
Pi— Рэ — ра = —2, 
—2p,+ 2р — P3 = — 5, 
Әрі- Pa— Pat ра — — 5, 
Table 6.3 
„= | m | » | pa | Constant | n | 
[2] 3 1 0 -5 1 
1 -4 -4 0 2 —8 
-2 2 -4 0 -5 —6 
3 -1 | 1 1 -5 -3 
4 | 0.5 | 0 —2.5 | 0.5 | 
[72.5] -1.5 | 0 —0.5 -3.5 | 3.5 
5 0 0 —10 —5 —5 
—5.5 | —2.5 4 2.5 -4.5 -4.5 
4 0.6 0 —0.2 | 1.4 1.4 
[73] 0 -9 | —12 —42 
0.8 1 1.4 3.2 3.2 
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which can be solved with the use of the scheme of unique division 
(see Table 6.3). 
Consequently, 


D (А) = А — АЗ — 233 -|- Зл —1. A 


6.4. Using Krylov's Method for Calculation 
of Eigenvectors 


If the coefficients Pi, Pas ..., p, and the roots А, 
№, ..., Ag OF the characteristic polynomial are known, 
then Krylov's method makes it possible to find the corre- 
sponding eigenvectors from the following formula: 


xO i yD E guy" DE LL. да-а, Ly? 
(і--1,2,..., n). (1) 
Неге y("-), y(072, ..., y are vectors used for seeking 
the coelticichts pj, Py, - . ., Pn by Krylov's method and 
the coefficients qj; (j = 1,2,...,n —1,i =1,2,...,n) 
can be found using Horner's scheme: 
doi — 5, Чи = sit Pj (2) 


Example. Use Krylov's method to find the eigenvectors of the 
matrix 
1 —1 —1 2 
2 3 0 —4 
1 1—2 —2 
1 1 9-41 


А- 


AThe characteristic polynomial of the matrix A is known: 
det (A — М) = А — АЗ — 292 4-34 — 1 


(see Example 2 in 6.3) and the eigenvalues are А, = A, = 1, А = 





0.618, A, = — 1.618. To find the eigenvectors, we use for- 
Table 6.4 
^L m=: | рї =1 | pa -2 | ра = 3 
№ = 1 Яо == 1 | 911 =0) 41-5 — 91 = 1 
№ = 1 do —1| 912 =0 Gag -2 Яза = 1 


hg=0.618 [доз —1| а= —0.382| q,4— —2.236| дэз — 1.018 
A, —1.048 |g =1] фи=—2.618| q,,-2.226. | дә, = — 0.618 
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mula (4): 
хб) = уб) + ауу + gory) + gay. 


Неге 90; = 1 and the coefficients qj; (j =- 1, 2, 3, i = 1, 2, 3, 4) 
can be found with the use of IIorner's scheme (see Table 6.4). 

We employ the expressions for the vectors убо), y(D, уб), y, 
which we have found in Example 2 in 6.3, and obtain 


4 6 2 
4 -4 —4 
xn-x5-| i|-o| 4|-2| 2 
3 2-4 —1 
0 0 0 
of |2] [4 |, 
+ of tho |? 
1 6 0.5 
4 б 2 
4 —4 —4 
хб) =| ;|-038| ,|—2239| Z3 
3 -і —1 
0 — 2.764 0,19 
ol | 14472) | 1 |. 
+ 1.618] o | | 4.056 | 7| —0.07 |' 
1 1.236 0,50 
4 6 2 
4 -4 4 
x)=] ,|-268| ;|-2235| 5 
3 —4 —4 
0 — 1.236 — 0.38 
ol 5.528 0.29 
—0.618 | ЕМІ + fe А 
1 2.764 0,15 


6.5. Тһе Leverrier- Faddeev Method 


This method was suggested by Leverrier and then sim- 
plified by the Soviet mathematician Faddeev. The meth- 
od of Leverrier is based on Newton’s formulas for the 
sums of the powers of the roots of an algebraic equation 
and consists in the following. Assume that 


det (A— А) =A" ру... ps (1) 
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is a characteristic polynomial of the matrix A = [a,j] 
(where i —1,2,...,nj = 1,2, n) and Ay, Ag, ..., 
М isa complete set of roots of polynomial (1). Consider 
the sums 


Sí MHM... AR (Е -1,2,..., п), 


9. --А ФА... РА, =Tr aA, 
S, -М+А Б... БА = Tr A’, 


Sa АЕА Б... | An Tr AU 


(each sum S, is а trace of Ше matrix A“). Then, for k н 
there hold Newton's formulas 


Әсі БӚ lee PaaS Pas 


whence we find that 


n — S, for k- 1 
ps — (Sa 5) fork -2 
(2) 
Pro —-- (8, 4- PSna i PaSa- t ++ v Pn) to kn. 


Consequently, Ше coefficients of the characteristic 
polynomial Pi» Pay + ps Can be easily found when the 
sums Si, 9), ..., 9, are known. 

Thus Leverrier's scheme for seeking à characteristic 
determinant is the following: 

(1) we calculate the powers A^ = A-LA (2-1, 
2, ..., R) 

(2) we find the sums Sp which are the sums of the 
principal elements of the matrices А". 

(3) and then we use formulas (2) to find the coefficients 
p, (і-1,29,..., n). 

The modified Leverrier method, suggested by Faddeev, 
consists in calculating the sequence of matrices А;, 
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4,,..., A, according to the following scheme: 
А,-- А, TrA =, B, A,— 1, 


A, — AB,, TA. qə, B, = A,— ф,1, (3) 


Tr An- 
Án = AB, s, PECES 


= Qn. Bay = Asa фа, 


А,- АВ, 1, 194%. В, A, — 9.1 (B, isa zero matis), 
4477 — Pav ds Par ee ey Qna — Pn- Mm- Ра: 


Example 1. Use the Leverrier-Faddeev method to expand the 
characteristic determinant of the matrix 


1—1 —1 2 
2 8 0--4 
А=| 1 4-2-2 
1 1 0 —1. 
A Wo successively obtain 
1—1 —1 2 


2 з 0-4 
4) А-А-|| iz s| n^TrA-143-2—1 


1 1 0-41 





: 0-1-4 2 
2 2 0—4 
Bix Ar—nl=)4 1.32}, 
1 4 0-2 
1-1 4 2770 -1-14 2 
2 з 0—4||2 2 0-4 
(2) Аа=АВ =], 4 29 2/14 1 3-2 
1240-4141 0—2 
-1-2 24 
| 2 0—20] та, -14045-0 , 
=|--2 —3 56| 257z > 2 74. 
1 0—40 
“3-2 2 4 
2-2-2 0 
B—4-5-| 2 3 3 в 


1 0—1 —2 
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1-4-4 277-3-2 2 4 
2 з 0—4 2-2 —2 0 
(3) Аз-4А8,-|| 4..2.2||—2—3 з 6 
4 4 0-4 1 0 —4 —2 
2103-4-60 
—4 —140 2 46 O TrA 


1 2—4 A 773 
—2 -4 1 & 


—1—10—4-- 6 








2 3 —1 —6! 
--4 --7 2 16 





Bys As—= qi=] 4 9 4 аА 
—2 —4 1 9 
1—1 —1 27 2 3 —1 —67 
2 3 D —4 —4 —' 2 16 
(4) 447483— |, 4 3 52 102 —4 —4 
1 1 а 1 —2 --4 1 9. 
40007 
ІШ ЕШ! Tray itiiti _, 
“Toorop алт eg m 
00041 
oona 
өзө 
BAS = | уулуу Je 
опоо 
(5) Thus p, 794 DUO у ші -- 
3, Pa = — 445 — апа D (A) = a "C Козун Vu 


The modification of Leverrier's method, suggested by 
Faddeev, makes it possible to lind the inverse matrix А 7 
From formulas (3) we have A, = АВ, B, =A, — 
4а! = On, whence it follows that A, = qnl, or 


АВ, тп 4,1. (4) 


Premultiplyiug relation (4) by 47!, we obtain А ПАВ, у= 
А 14,1, whence we find that 


Act Вал ор Ant Pea (5) 
Qn — Pn 


17—0104 
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Example 2. Calculate the inverse of the matrix A given in 
Example 1. 
А Using formula (5), we obtain 
2 3 —1 —6 
В) | 4. —4 —1 2 16 
—p, 1 2 —1 —4 
—2 —4 1 9 


A= 





Verification: 


-1-4-402 2 3 —1 —6]p1000 
a2 3 оар ат 2 аврояоо 
Алі 4-2 —2 1 2 —4 4 | 10010 | А 

1 1 0 4*db-2-4 4 9118004 


6.6. Using the Leverrier-Faddeey Method 
for Calculation of Eigenvectors 


И the matrices Bı, В, ..., В, Obtained by Ше 
Leverrier-Faddeev method and the roots Aj, Azs e.. An 
of the characteristic polynomial D (А) are known, then 
the eigenvectors x(? can be found from the formula 


хб = Ag" Me + Aj"? b, + APP b+... + bags 
where e is a unit vector and b,, b,, . . ., b,., are column 


vectors of the matrices В), Ba, ..., В, of the same 
order as e. - 


Example. Calculate tho eigenvectors of the matrix 


1-1—1 2 
А-|2 3 0 —4 
1 4—2 EI 
1 1 0-41 
if the matrices B. By B, (seo Example 1 in 6,5) and the cigenvalues 
Ay = А, 0.018, М = — 1.168 of the characteristic 
тоса D d = М — М — 280 + ЗА — 1 are known. 
79 2 4 
0 —4 0 
A We take e=] ,, | and then b,—] | 5], b= el ат 
1 —2 —2. 
16 : А 
—4 | (the fourth columns of tho matrices B,, B}, Вз). From the 


9 
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formula x(+)=)je-} 3b + Ab, + bs we find that 














07 2 4 —6 0 
0 —4 0 16 
xt) =x = tej o |1) 5 |0 el^ = 12 
1 --2 --2 9 6 
0 2 4 
0 —4 ü 
x@) — 0,6189 0 + 11.6182 —9 + 0.618 6 
1 —2 —2 
—6 — 2.164 
16 14.472 
+ —4| | —1.056[, 
9 1.236 
0 2 47 
0 --4 0 
хб) = (—1.0649]  |-+(—1.618)?] 5 |--(—1019 | 6 
1 —2 —2J 
—6 — 7.236 
16 5.528 
+] —4 |=] —18.944 | 
9 2.104 
We tabulate tho results of the calculations as follows: 
Table 6.5 
ay | I | II | III IV у | УІ 
n 2 4 —6 0 | Т 
0) —4 а 16 12 1 
Ме-А-1 ü -2 6 -4 0 0 
1 -2 -2 6 6 | 0.5 
0 0.764 2.472] —6 --2.764 0.19 
мовив | © |-152 0 16 | 14.472] 1 
35 0 — 0.764 3.98 -4 — 41.0561 —0.07 
0.236] — 0.764] —– 1.236 9 7.236 0.50 
0 5.236] —6.472| —6 —7.236; —0.38 
A = —1.618 9 —10.472 0 16 5.528 0.29 
ammo 0 —5.236| --9.708| —4 | —18.944 1 
—4.236| —5.236 3.236 9 2.764 0.15 


17% 
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Columns 11, III and IV are the coordinates of the fourth column 
of the matrices B, multiplied by tho corresponding powers of A, 
ZU 


0 
and column I includes the coordinates of tlie vector М ole Column V 


1 


contains the coordinates of the vectors х(ї) and column VI contains 
their coordinates after normalization. & 


6.7. Danilevsky's Method 


Two matrices A and В are said to be similar if ono of them can 
be obtained from the other by means of a transformation with the 
use of a nonsingular matrix, i.c. if the equality 


В == $3148 


is satised. Ifa matrix В is similar to a matrix A, then we 
write B~ A. 

In Danilevsky's method the construction of the scheme for 
computation is based on the principal property of similar matrices: 
similar matrices have similar characteristic polynomials. 

If we use similitude transformations to reduce the matrix 


411 41: Gig ... Gin 
231 444 O53 ... Fon 
A=] аз, аз азу ... бҙһ (1) 
Uni nz Gng --+ Ann 
to tke so-called Frobenius form 
Һа fia һа. fas nea fin | 
1 0 0 ...0 9 
F=]0 1 0 ...0 0 (2) 
0 0 0 ...4 0 


and then expand the determinant 
fu—^ Па Һа... fun- fin 


1 —A 0...0 0 
det (ЕА) =| 0 4 —A e.0 0 (3) 
0 в 0 22 1 Е 2% | 


according to the elements of the first row, we obtain 
D (A) = det (F — M) = (fiy — № (—9?3 — fi (Ап 
ck Аз C9? 3 — ... + (71)? Hf,, 
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or 
D (А) = det (F — AI) = (—4)" (л — p,Àn-1 — p,An-à 
—p3M73 — ... рл). (4) 


Here p, = fi Pa = hi, рз = fin ee = fj, are the coeffi- 
cients of the characteristic polynomial. of the matrix Е, which, by 
virtue of the similarity of the matrices F and А, are also the co- 
efficients of the characteristic polynomial of the matrix 4. 

In accordance with Danilevsky's method, the matrix A can be 
turned into the Frobenius matrix F similar to it with the help 
of n — 1 similitude transformations which successively transform 
the rows of the matrix A, beginning with the last row, into the 
corresponding rows of the matrix F. 

The scheme for transformation of the matrix A intoa Frobenius 
matrix F similar to it. 19, Suppose we have to transform the row 
аһ йә... +, 12455» into a row 00. 10. Assuming that 
an.n- Æ 0, we "divide all the elements of the (n -— 1)th column 
от the matrix A by ар, ,,.,. Then its nth row assumes the form 


Ün, n-1 





апійһә •.. ann, OF ауу Any ... 1 аһ. 


ар, n-1 


29, We subtract the (n — 1)th column of the transformed matrix, 
multiplied by the numbers anı, Gng» . . ., ал, respectively, from 
all the other columns. For the nth row we obtain 


ani — "nidno T 48... 1a,5 — Ann, OT 00...10. 


3°. We take the matrix .1/,,_,, obtained from the identity matrix 
as a result of the same transformations, as a nonsingular matrix: 





_ 1 0] Se. 000 1 = 
0 1 2.0” Т 
М n- = 
not Mn-1,1 Тығыз © © Mn-is n-i Mn-isn ' 
- 0 0 а 1 - 
whero 
Ani 1 
Mn-1, i= —— -, "р-р, n-ai O. (5) 
an,n- ` an, n-1 


The operations performed are equivalent to the postmultiplication 
of the matrix М,.) by the matrix A: 


аһ 41% «++ Qten-1 біп 

а aag e 4зун-і (бәл 
В-АМ,1-)Р............... "m 

45-1, 1 Qn-1, 2 +--+ n-i, n-1 Ün-1, п 


0 0 es 1 0 
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1 0 0 0 
0 1 0 0 
x . . . ........ 
Mn-1,1 ™n-1,9 ++. Mn-1,n-1 Mn-i, n 
0 0 0 1 
bu biz Dno bimn 
ba ба tb. n bon 


bn-1, 1 Әл-1,0>-. Әп-1.п-і Әп-і.п 
0 n 2.1 0 . 
The elements of the matrix В can he found from the formulas 
bi; = aij + а, na, jr Брат (6) 
However, the matrix В = AM,., we have constructed is not 
similar to the matrix A. 
4°. To obtain a transformation of similitude, we must premul- 
tiply the inverse matrix Мҙ!, by the matrix В: 
МА, AMn- = МВ. 
Тһе inverse matrix Mz, has the form 


6, n-1 My 3, n-i 


1 ü .0 0 

0 1 0 а 
М, = а . 

апі Ong --+ Ün, n-1 nn 

0 0 2.0 1 


We set M5!,4 M,., = C, and, consequently, С = Mz',B. The 
premultiplication of the matrix Mnt, by the matrix B does not 
alter the transformed row of the latter and the matrix C has the 
form 


1 0 .0 0 
n 1 2... 0 0 
C= M3, B= .2.4...4...... 
апі Qna * ал, n-1 fnn 
f) 0 .. O 1 
bu bia 0 bunn- біп 
b, bos e Dg nea bon 
x| ....- .......... 
bn-1,1 бл-1,2 o бп-1, п-1 Өт-іп 
0 0 1 0 
€£1,n-1 Cin 
Co, n-1 ‘on 


€11 €1» ... 
€21 Coo “+. 
Сһ-1,1 ©п-—1,2 °°: 
n 0 ... 


Cn-1, n-1 €Cn-1, п 


1 0 
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Indeed, multiplying the matrix Мҙ!, by В, we only change the 
(n — 1)th row of the matrix B since сұ) = bj, for all the other 
rows, The elements of this row can be found from the formulas 


n 
€n-1, J= Ў) апһіһ) (іі, 2, ..., п). (7) 
Һ«-1 


Tho matrix C obtained is similar to the matrix А and has one rc- 
duced row. 

5% Furthermore, if cn-1, 4.4 0, we perform similar opera- 
tions for the matrix C, taking the (n — 2)th row as the principal 
row. Then, using the intermediate matrix D= CM, _,, we get 
a matrix Г = M3',D = М!» Смп-. with two reduced rows. We 
perform the same operations for the matrix J and so on until we 
obtain a Frobenius matrix. 

АП these transformations are written as a computational scheme. 
The following example shows how it is formed. 

;xample 1. Uso Danilevsky's method to expand the characteris- 
tic determinant of the matrix 


7—45 —3 1 17 
2 0 4 —1 
A=] 4 4 2-2]: 
= 41 1 —4 —1- 
A 1st stage. We reduce the matrix А to the Frobenius form and 


compile a table to make calculations (sce Table 6.6). 
(1) We put the elements aj; (i, j = 1, 2, 3, 4) of the matrix А 
4 


into rows 1-4 of the table and the control sums а; = > а = 


= 
(i = 1, 2, 3, 4) into the column Z. Then we mark the element 
аз == — 1 which is in the third column (marked column). 
(2) We write the elements of the third row of the matrix M, у = 
M, found from formulas (5), in row 1: 











ay 1 ал» 1 
= = = —— =i ө 2 —— ee = 
ms, аз —1 . Mao aq —1 1, 
104.20 _ 044 —1 
тур1 та” тъ р 
-- 00 2 
Moz == as —1 -- 0, 


The number 0 must coincide with the sum of the elements of 
row I after substituting —1 for the value of the clement тҙҙ obtai- 
ned, but in this example m,, = —1. (For the sake of convenience 
the number —1 is usually written beside the element тз; and 
is separated from it by a line.) 

(3) We write the third row of the matrix M3!, which must coin- 
cide with the fourth row of the original matrix A, in rows 5-8 and 
the column for M-!. 
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Table 6.6 
Columns 
Rows Мті У X 
1 | 2 | 3 | 4 
1 -4 -3 1 1 --5 
2 2 0 4 —1 5 
3 1 1 2 -2 2 
4 1 1 —1 | —1 0 
t 1 —1 —1 | 0 | 
5 1 —3 -2 --1 0 --6 —5 
6 1 6 4 —4 -5 1 5 
7 —1 3 3 -2 —4 n 2 
8 —1 0 0 1 0 1 а 
T | T (Eq -4 | -1 | —ü | 
M, 
П а 1-41 —4 —1 | -8 
M3! 
| LL. 
9 а –3 2 7 2 8 б 
10 —1 6 —4 | —20 —1) --27 — 23 
11 —4 0 1 0 0 1 0 
12 —1 0 0 1 0 1 0 
40° | -6 | o | 10 | 9 | 22 
M, 7 
ПІ 0.167 —1 01 3.167} 1.50 | 3.667 
Мү! 
13 —6 0.500 1|2.000|—2.500 |—2.500 |—2.500 | —3 
14 0 1 0 a 0 1 0 
15 19 0 1 0 0 1 ü 
16 9 0 0 1 0 1 0 


13! ‚| -3 fa] м s | s | 
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(4) Then we write the elements of the matrix B -= А.М.. 
found from formulas (6) for the unmarked columns, in rows 5 8 
and the appropriate columns. 

The first column is 


bn = ап + tamy = — 4+ 1-1 = — 3, 

by, = аур + аута = 2 |- 4-1 = б, 

bg, = аз + азутзү = 1 | 2-1 = 3, 

Day = 244 o аата = 1 H- (— 1):1 = 0, 
The second column is 


bis = fyah ата —3 01:14 = — 2, 
із -= Qaa {> 4 лы = 0 | 4-1 7 4, 
baa = аз b AygMtgg 0d 524 3, 
Раз -= ааз F Gay mas = d 100 DH -0, 
The fourth coluinn is 
bacc ayy F 4.43, 5: LR 1. (0 = 9, 
bai =~ ам-і- ғаты ---1--4-(-1)-- - 5, 
bgg c a4 Clo ayang 2--2(-4) = — 4, 
баа = ада арат = -- 1 5 0 0-(— 0 7: 0. 


‘The transfor med elements of the third (marked) column аге ob- 
tained by multiplying the initial elements by my, = -- 1 
The third column is 


bis = aiamaa 55 1-(- 1-4, 
bag = azyma 75 А (—1) = —4, 
bas = аузу 77 2. (—1) шш —2, 


Басс ата co (5 0) (—1) = 1, 
The last row of the matrix B must have the form 001 6 
То verify the calculations, we add to the matrix В the corre- 
, . 
sponding elements of the column for N transformed with the use ot 
the analogous binomial formulas for mas =- 





bye = aip E ату = — 5 -+ 1-0 = --5, 
bog = Asp -F aa as = 0 -H 4-0 = 5, 

bag o ар bo алута, = 2-|-2.0-- 2, 

bya = aasch agamas = 0-|- (— 4)0-0 


We write the results obtained in the column for “ іп the арргор- 


riate rows. Adding to the clements of the column for SY’ the corre- 


sponding elements of the third (marked) column, we get the control 
sums for rows 5-8 (i — 1, 2, 3, 4). t. 


The column > is 


bis = big + agg = — 5 — 1 = — б, ba = bag а= 5—4=1, 
bas = by T- азу = 2— 2 = 0, bas = bao + ааз = 0-1 = 
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In addition, for the sako of verification, the elements of the 
4 
column У! are calculated with the use of the formula bjs = У ы 
21 
(i= 1, 2, 3, 4): 
bis = 01 + bia + bis + bu = —8--2—14-0— — 6, 
Bas = ba + bos + bas + bu = 644 —4— 5 = 1, 
bas = Бу + baa + baa + 034 = 34+3—2—4=0, 
bay = Bay F Ва + baa бы = 02-0 4-1 4-0 — 4. 
fhe matrix B of the form 
7—3 —2 .-1 в” 
6 1-4 —5 


3 3 2 —4 
- 0 0 1 M= 


В - 


(5) The transformation Му! which is performed оп the mat- 
rix B and which yields а matrix C = M3!B, alters only tho 
third row of the matrix B, i.e. the seventh row of the table. The 
elements of this transformed row 7' constitute the sums of paired 
products of the elements of the column for Мҙ1, which are'in rows 
5-8, by the corresponding elements of each of the columns of the 
matrix B [see formula (7)]: 


em = 1-(-3) + 4-6 4- (740-3 + (—41)-0 = 0, 
з-4-(-2)--4-4--(-0,38--(- 10 = —4, 
са = (Е 1 (74) + (—1)+(—-2)-(—1)31 = —4, 
es = 400 + 44(75) + (70- (24) + (—1)+0 = A. 
We transform the column for X in the same way: 
са = 1: (7 0) + 141 + (51-0 + (—1)-1 = —6. 
As a result we get a matrix C consisting of rows 5, 6, 7’, 8 with 
the control sums in the column for У: 
--3 —2 —14 n 
6 4 —4 —5 
0 [-1] —4 —1 
0 0 1 0 
The matrix C is similar to the matrix A and has one reduced row. 
This completes the construction of the first similitude transforma- 
tion: € = МТА M. 
2nd stage. Assuming the matrix C to be the original ono, we 


separate the element сау == — 1 (the second column) and continue 
the process by analogy. 
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(1) We find the elements of the matrix M,_, = М, from for- 
mulas (5): 














= а an aif __ 
тај = с) Z Ma, = ca —1 1, 
no fs 4 шм 1 
mag = Сөз -- —1 = 4, тод = Cap — —1 1, 
бав c9 2. 
Mgs = mU —1 6. 
We sum up 0 — 4 — 4 — 4 = — 6 (mg, = — 1, if mg, were not 


equal to —1, then we should have replaced Mag by —1). 

(2 Then we write the second row of the matrix Mj}, which 
coincides with the third row of the matrix C, in rows 9-12 and the 
column for M-* (sce Table 6.6). We find the elements of the mat- 
rix D — СМ,. 

The first column is 

da = — 3 + (— 2)-0 = — 3, 4, = 6 + 4:0 = 6, 
dg = 0+0=0. 

The second (marked) column results from the multiplication of 
the corresponding elements of the matrix С by my, = —1: 

dig = cama = (—2): (— 1) = 2, dag = Сат, = 4: (—1) = — 4, 
Яза = ©ту, = (-1)(- 1) = 1. 
The third column is 


Фа = суз + студ > -- 1 + (—2)-(—4) = 7, 
dan = сэз T- сату = --4-БА-(-4) = - 20, 
dyy = сэз “| CggMoy =- 4-b (--1)- (--4) = 0. 


The fourth column is 
dia = сы F сата = 0:1 -+ (—2)- (—1) = 2, 


dog = Coq + <өту- — 5 H- 4: (— 1) = -9, 

dga = ©з + саты = — 1 + (—1):(—1) = 0. 
The column for 2” is 

dig = cis + Ciomas = — 0 + (—2)-(—6) = 6, 

dog = Cop T- сеть = 1 + 4: (—6) = —23, 

dgs = cas + сұт = — 6 + (—1):(—6) = 0. 


The elements of the column for Z result from the addition of the 
elements of the column for У” to the corresponding elements of 
the marked column: 


dıs = dig t+ dj, —6 + 2 


8, das = dag + dgg = —23—4=—27, 
dæ = dg + dp = 0+1 = 1. 
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The matrix D has the form 


—3 2 7 2 
6 —4 — 20 —9 
0 4 0 49 
-0 0 1 n 


D= 


The transformation M3}, which was performed on the matrix D 
and which yields J = МҰ, alters only the second row of tho 
matrix D, i.c. the tenth row of the table. The elements of this 
transformed row 10’ are the sums of the paired products of the 
elerents of the column for Mz! which are in rows 9-12: 


е = 0-0 3) -E (710-6 4 (—4)-0 4- (70-0 = — 6, 
аз `= 0-34 (-41)-(-4) + (—4)-1 + (—1)-0 = 0, 
esa = 0:7 + (—1): (—- 20) [> (54)-0 4: (71)41 -= 18, 
е, = 02 + (—1)-(— 9) + (6-40 -+ ( -0-0 = 9, 
е = 0:8 1-(-4)(- 27) |-(—4)-1-[-(-—1)-1 ++ 22, 
Ze; = — 6+ 04 19 4- 9 = 22. 
This completes the construction of the second transformation of 
similitude: J = M;!CM,. The matrix J ~ C has two reduced rows: 


—3 272 

| —6 | 0 mma 
l= 

00400 

а о да 


3rd stage. We assume the matrix / to be the original one. We 
separate the element eg, = - 6 (the first column) in it and trans- 
form the matrix / into a similar Frohenius matrix F. Continuing 
the process by analogy, we lind, from formulas (5), the elements 





of the matrix M,.4 My: 
1 1 бөз 0 
= — Ll =- — i} 7 т Ll. хі — c 
ту "" 7 407, тр Рр =; 0, 
ёза 049 440 ‚гм 2 
Has = cu 7 — = 3,107, mi--— „= - 1.500, 
26а о _ 29 506 
Mis = "s 6 = 3.607. 
To obtain the sum У = 3.667, we replace m,, -- —0.167 by —1: 
27--1--0--38467 -H 1.500 = 3.667. 


We write the Frobenius matrix / in rows 13-16. We first con- 
struct G = ІМ, and then F = MG. In the column 7/7! we write 
row 10’ of the matrix J (sec Table 6.6). 
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The first (marked) column is 
Ei = ёүүтүү сє (-- 3) (— 0.167) >= 0.500, 
for = батыс (— 0) (- 0407) = 1.000. 
The second column is 
Eig = eig F eag = 2 -|- (—3)-0 = 2.000, 
Bea = €x F өту = 0 |-(-0б)-0-- 0. 
The third column is 
£19 = ез F enama = Т f- (—3)-3.467 = — 2.500, 
Баз T Фа 1- Өлі 7 19 + (—6)- 3.0167. = 0, 
The fourth column is 
Bis = en F ema = 2 i (—3): 1.500 -+ --2.200, 
Bay = Cog F біті = 9 -+ (—0)-1.500 = 0. 
Tho column for X’ is 
ia ль F eum = 8-І (—3)-3.667 = —3. 
Boa = е» + еті, = 22 -H (—0)-3.607 = 0. 
Tho column for У is 


fis = Eie (| Eu = — З + 0.500 = — 2.500 
Eis. 7 81 + gie T Big + Eis = 9.500 + 2.000 —2.500 
— 2,500 = — 2.500, 


Has = 6 6a = 01 — 1, 
Езу = Bub Boat без + Es. 7 1 dO EO 0 = 1. 


The elements of the transformed row 13' are the өш” of the 
paired products of the column for M;' which are in row 13-16: 


Jı = (-9):0.500 + 0-4 + 19-0 -+ 9-0 = —3, 
Jia = (—6)-2.000 4- 0-0 + 19-1 + 9:0 = 7, 

fig = (-0)-(-2.500) + 0-0 + 19-0 -+ 9-1 = 24, 
һа = (-0)-(-2.500) + 0-0-- 19-0 + 9-0 = 15, 
У = (-6)-(—2,500) +0-14-19-14-9-41 = 43, 


У = -= 3 + 7 4 24 - 15 = 43. 
Thus the required Frobenius matrix F, similar to A, has tho form 


—3 724 151 
10 0 UO 
Е- 0400 
00 10 


270 Computational Mathematics 


We seek the characteristic determinant of the matrix F: 


-8-Х 7 24 15 


1 — 0 0 
D (А) = det (A—AI)—det(F—X1)—| |, А —A 0 
Ü 0 1 —À 


From this, expanding the determinant D(A) according to the 
elements of the first row, we obtain 


—3— 7 24 15 








1 A 00 -. 0 9 

D()-| 4 (oca 0-С3-У| 1-4 o 
0 0 4X 01-3 

1 0 0 1 —À Ü 1 —\ 0 

--7|0-А 0 |24 |0 4 01—451 0 1 —А 

0 4-4 0 0 А 0 0 4 




















=(—3—А(— А) — 7X3 4-24 (—A) —15 
== M + ЗАз — 743 — 24), — 15.A 


Particular cases in Danilevsky's method. This method can be 
used without any complications if all the separated elements are 
nonzero (as in the example just considered). Now if as a result of 
the transformation of the matrix A = [a,;] (i — 1, 2, ..., п, 


j = 1,2,..., n) into the Frobenius matrix F, we get a matrix of 
the form 
dij дуз ... ур... dy hoa dik +++ dy n-i din 7 
дз daa ... ды ... de, 4-1 dak ... da, n-1 dan 
diy dig. ... 6... di, а-а dik >... di, n-i din 
pal docct ttt ttm ttn 
dhi Фа --- ды ..- dh h-i dhh -+> dh, n-i Фа |! 
0 0 ...0 ..% 1 ee A 0 
0 0 0 ..0 0 1 0 


and find that 2р, 4., = 0, then we cannot continue with the transe 
formations using Danilevsky's method. Two cases are possible here. 

1st case. Assume that an element of the matrix D, which lies to 
the left of the zero element dy, ,_,, is nonzero, say dy, 5 0, where 
l< К — f. Then we replace the zero element dx, 4-1 by it, i.e. in- 
terchange the (k — 1)th and [th columns of the matrix D and simulta- 
neously interchange its (k — 1)th and Ith rows. Thè new matrix is 
similar to the given one and we can continue with the calculations 
using Danilevsky's method. 
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2nd case. Assume that d}; = 0 (l = 1,2, , k — 1), i.e. that 
the separated element and all the elements of the matrix which аге 


to the left of the separated ono are zero. Then tho matrix D has 
the form 


“а, diz ttt di, h-1 dih ttt di, n-1 din т 
dài dye s+ з, hoi — |dak e dg п-а dan 
Dex аһ-1,. 1 dh-1,2 -++ @ң-ї,н-1 (dana --. drat n-i @н-ї,п 
“0 a we 0 dkh „++ dh, n-1 dhn 
Т a ST 1 NT T 


-[r]. 


Wo divide the matrix D into four cells so that one matrix is 
zero. Then the characteristic determinant det (D — AJ) breaks 
into two determinants: 


det (D — M) = det (D, - M)-det (Dy — М). 


but the matrix D, has now the form of the Frobenius matrix and 
therofore it remains to reduce the matrix D, to this form. 











Table 6.7 
Columns 
Rows M^1 x r 
1 | 2 | 3 | 4 
1 3 —2 1 —1 1 | 
2 3 -2 1 1 8 | 
3 5 —4 2 0 3 
4 -1| -1| fq [о | 
I | 1 1 | 11-41 —1 | 0 | 
5 —1 4 --1 1 -2 2 1 
6 —1 4 —1 1 а 4 3 
7 1 7 -2 2 —2 5 3 
8 1 0 0 1 0 1 а 
r | 
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Example 2. Use Danilevsky's method to expand the characteris- 
tic determinant of the matrix 


^ 3-24-47 

3 —21 1 

А-| 542 0 
—1—11 íd 


A We tabulate tho calculations (soe Table 6.7). Tho separated 
element cs, = 0; we cannot continue the calculations using Dani- 




















Table 6.8 
Columns 
Rows M-1 T_T TT > 5, 
1 | 2 3 4 

5 —1 —1 4 1 0 4 

6 —1 —41 4 1 -2 2 

7! 1 0 |[=4| 1 iN И 

8 4 0 | 1 0 1 

М, 
П 9 —1 1 0 0 
M5! 

9 0 —1 —4 5 0 0 4 
10 —1 —1 —4 5 -2 —2 2 
11 1 ü 1 0 u 1 0 
12 0 0 0 1 0 1 0 

М, 
III 11-4 -5 5 -2 —3 
Мт! 
13 1 —1 1 0 2 2 8 

14 5 1 0 0 0 1 0 
15 -5 0 1 0 0 1 0 
16 2 0 0 4 0 1 0 
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levsky's method. Since cs, = 0, we interchange the second and the 
first column, the first and the second row of the matrix C and con- 
tinue with the calculations (see Table 6.8). 


As a result we obtain a Frobenius matrix Р со A: 


whence we find that 
D (A) = det (A — М) = det (F — AI) = M — AM 
+ 42 — 23 4 2. А 


Example 3. Use Danilevsky's method to expand the character- 
istic deterininant of the matrix 


-0 4 
14 
А=| 41 
11 


= bcc] 
= =>» DW 


A We tabulate the results of the calculations (see Table 6.9). 

Since the separated element is equal to zero, we cannot continue 
the calculations using Danilevsky's scheme. 

Tho matrix D c^ C has the form 


-1|045-25 257 


роге 4 —7 
D= 0| 1 о oJ 
ojlo 1 0. 





We partition the matrix D into four cells by bordering and 
compute / (A): 





1-2] 05-25 25 
D () = det (D—AI) — М 674 EN m 
0 9 1 —À 
бА 4-7 
-aali А 0-4 А-А) ААА —7] 
1 4 —À 








= дА ТА -|- 232-114 — 7. А 
18—0104 
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Table 6.9 
Columns 
Rows M-1 = х, 
1 | 2 | a | 4 
4 0 4 3 2 6 
2 1 4 5 0 10 
i 1 1 | 2 1 5 
4 1 1 1 1 4 
Ш | 
І —1 —1 1 -1|[-1 -4 | 
5 1 -3 —2 3 —1 -3 —6 
6 1 —4 —1 9 —5 -5 --10 
1 1 —1 -1 2 -і —1 —3 
8 4 | 0 0 1 0 1 0 
PL ste ee 
II —2 —0.25 —1 2.75|—1.75| —2 
9 —8 1 0.5 —2.5 2.5 1.5 1 
10 —4 —2 0.25 2.25|—3.25|—2.75| —3 
11 11 0 1 0 0 1 0 
12 —17 0 0 1 0 1 0 


6.8. Using Danilevsky's Method for Calculation 
of Eigenvectors 


Let y = (Jj у, . · ., Jn) be an eigenvector of the 
Frobenius matrix / corresponding to the given value of 
å. Then Fy = Ау, whence we have (F — AI) y = 0, 
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or 
Мі-М fa fas fin yı 
1 —ÀÀ 0 ...—0 ya 

0 1-А ... 9 [L|]. ЕЗУ (1) 
9004 0... A " 

Carrying out multiplication, we get a system for deter- 
mining the coordinates y,, yj, ..- Yn of the eigenvec- 
Lor y: 

(ҺА i Pisa d- Pasa t 1 finun = 0, 
уу— уо = 0, 

Ja — ys =, (1°) 
Уп-1— Ayn = 0. 


This system of linear equations is homogeneous. We can 
find its solutions to within the proportionality factor in the 
following way. We set y, = 1 and then successively 
find that 


Yn- = А, Yn- = Mn, А, ..., ya M. 
Thus the required cigenvector is 


Anu 


àn-2 
=|: | (2) 


1 


Since the matrix / is similar to A, А is also an eigenvalue 
of the matrix А. 

We designate the cigenvector of the matrix A, corre- 
sponding to the value A as z = (z,, Zn, .. ., Zn). Then we 
obtain 


x= Manang M, My, (3) 


where M,.,, M,-.,...-, M, are identity matrices trans- 
formed by Danilevsky's method. 


Lae 
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For instance, the transformation M,, carried out on y, 
yields 


- n - 
yi mihl 
ті ті: Min рУ 1806 
Ve = 
o 4 0 
Му-|........ . : — Ya 
0 0 1 . : 
Un 
— Yn - 


Consequently, the transformation Л/, changes only the 
first coordinate of the vector y. Similarly, the transforma- 
tion M, changes only Lhe second coordinate of the vector 
Му etc. Repeating this process м — 1 times, we get the 
required cigenvector x of the matrix A. 


Example. It was shown in Example 1 of 6.7 that Danilevsky's 
method could be used to reduce the matrix 


---а -8 1 1 
° 2 0 4 --1 
1 1 2-2 
1 4-1-1 


to the Frobenius form 


—3 7 24 15 
10 0 0 
01.0 07° 
Ho 4j 0 


Ғ-- 


Calculate the eigenvector x(D :.- (ду, ry, 7, 24) if Àj = — 1. 
A We use formula (3), i.e. x == M4M,M, y, where 


[ЖЫ —1 
2 1 
à | | —1 
1 1 
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and take the matrices Мз, Ma, М, from Table 6.6. We find in 
succession that 


—0.167 0 3.187 4.500 4 p —1 - — 4.500 
0 10 0 1 1 
MY=) o 04 0 —1 |7| —ı , 
0 00 1 1 o 
1 o 0 0Or—415 —4.5 
0 —4 —4 —4 1 2 
MiMy-—lo o 4 olla Fla |, 
0 0 0 1 1 1 
10 0 04 r —1.5 —1.5 
() 0 0 y 5 
к©=мумзМ |а cac oi [| os 


nn а 4 1 1 


We can find by analogy the eigenvectors for the values of As, Аз, 24 
as well. A 


6.9. Using lterative Methods to Find 
the First Eigenvalue of a Matrix 


Iterative methods can be used to find the first (i.e. the 
grealest in absolule value) eigenvalue of the matrix A 
without evaluating the characteristic determinant. 

Assume that 


det (A — А) = 0 (1) 
is a characteristic equation, Àj. Ag, . . ., Àn are its roots 
which are the eigenvalues of the matrix А = [a,;] (where 
i=1, 2,..., n, j —1,2, ..., n). We assur > that 


А 21А |e] Ag 122... Sl м1, 


i.e. A, is an eigenvalue greatest in absolute value. 

Then, to lind the approximate value of the root АМ, we 
use the following scheme: 

(1) we arbitrarily choose the initial vector y, 

(2) set up the successive iterations: 


уФ-- Ay, 
у'® = A. Лу = А?у, 
y? == А. 42у = Ay, 


y™ — А. A™ty = A™y, 
уб"+0 = А. A™y = ACH, 
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(3) choose the last two values of the sequence у" = 
Ату and y™+ = A™*!y, and then 


) yn (m1) 

M lim ^v or MET (2) 
where yí"7*? and yj™ are the respective coordinates of 
the vectors (0*9 and у) (i = 1, 2, ..., n). 

Thus, taking a sufficiently large number of iteration m, 
we can calculate the root À,, greatest in absolute value, 
of the characteristic equation of the matrix, with any 
degree of accuracy. To find this root, we can use any coor- 
dinate of the vector y'?, in particular, tho arithmetic 
mean of the respective ratios for different coordinates. 

If the choice of the initial vector y is poor, formula (2) 
may not yield а needed rool or even lose sense, i.e. the 
limit of the ratio yi"*"/yf" may not exist. It is easy 
to detect the latter case from the "jumping" values of the 
ratio. If this occurs, the initial vector must be changed. 
The vector y(7*D can be taken as the first eigenvector. 


Example. Find the first eigenvalue of the matrix 


310 
А- t 
0 4 4 


(with three decimal digits) and the corresponding eigenvector. 


1 
A (1) We choose the initial vector | |. 
1 


(2) We set up m = 10 iterations: 
yO) = Ay, y@= A?y(), ..., y00) = Aly, 
We tabulate the results of the calculations (see Table 6.10). 


Table 6.10 


АЗу | А4у | Aby | Абу | Ату Айу Aly Alty 
































114) 17 | 69 | 274 | 1075 | 4189 |16 260 |62 973 | 243 569 | 941 37 
1|5]| 18 | 67 | 253 | 964 3693 |24 193 |54 650 | 210 663 | 812 58: 
1/21 17 | 25 | 92| 35|1309| 5002 |19 195 | 73845| 28450! 
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(3) Terminating the iterations with y(1)-- Aly, we have, fer 
different coordinates, 


yi _ 944370 





аз - 

AG) сє у? — 243560 3.865, 
са) и! _ 812585 _ 

МЫ қ 7/0 25210663 —3.857, 
(з› yw" 2 В 

MP a B= ды oP = 3.853. 


(4) We calculate À,, as the arithmetic mean of М?, А2) and АЗ): 
_ MP HAR 4 AQ? 3.865 4- 3.857 4- 3.853 


м 3 3 


— 3.858. 


941 370 
(5) We can take the vector у(10) = Aity = E Чч as the 
284 508 
first eigenvector of the matrix A. Normalizing it, i.e. dividing 
all of ite е» -3:nates by the norm of the vector equal to 
| yO lla = V 941 3702-4 812 5853 + 284 5083 = 1.28.4118, 


wo got the first eigenvector of the matrix А corresponding to the 
first eigenvalue A, = 3.858: 


0.74 
ха) = [0.64]. A 
0.22 


6.10. Determining the Successive Eigenvalues and 
the Corresponding Eigenveetors 


Let the eigenvalues of the matrix .1 be such at 
[Ag | > | A | 1А 12...21 1. (1) 


Then, to find Ау, we can employ the so-called A-differences, 
using Lhe value A, we have: 

A, A" y = A7 ty — MATY, Ay A™ ty — A" y — АА", 
or 

Аму =: ym — Му, Ay yn — ye yD, (2) 
whence, passing to the coordinates of the vectors, we find 
that 

Ay yp Ay 


А mi ите = gm Xp (і = 1, 2, "EP n). (3) 
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Formula (3) yields rough values of А, since the estimation 
of A, was also approximate. 

If the moduli of all the eigenvalues are different, then 
we can use formulas, similar to (3), to compute the other 
eigenvalues, but the successive results will be even less 
accurate. 

The number of the iteration m in the calculation of А, 
should be smaller than in the calculation of A, to obviate 
the loss of accuracy when subtracting close numbers. 


Example, For tho matrix 


310 
А-|122 
041 


find the second eigenvalue A, and the corresponding eigenvector x(2), 
Carry out the calculations for m — 8 iterations with three decimal 
digits. 

A We use the table of values of А пу for m = 7, 8,9 (see Ta- 
ble 6.10). 


А?у | А8у | A?y 


16 260 62 973 243 569 
14 193 54 650 210 663 
5002 19 195 73 845 


We employ formula (2) to set up A-differences: 
быу Y убт (4-4, 2, 3). 


For each row we take tho appropriate value oi À,: Af? -= 3.865, 
MP= 3.857, А) = 3.853. We get the following table. 

































Table 6.11 
А8у МмАТу 8),47у Абу | A1A8y | Ax, А8у 
m- ЕЗ 
62 973 62 845 128 243 569 179 
54 650 54 742 —92 210 663 —122 
19 272 --77 13 845 —113 
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(3) For each row we calculate A, using formula (3): 


AP 479 A, ye? —1422 
AUS aw IU -24.400, М-ы 00 — 1e i .320 
2 Ау 428 , 2 Ay ua? — 92 1 326, 
Avy = 113 
nw, MIA 2. 2119, 46 
МФ е т-р 140. 


(4) We deterinine А; as the arithmetic mean of AjU, Aj?) and 
A9: 
М 4-52 -AED 40-1:1,326 4 

м= Me кы ыыы ыны ыд — 1.398. 


(5) As the second cigenvector we take 


^ 470 
к(%)- А, A8y- | — 122 |. 


- 113 


Normaliziig 2% we have 
b. 


С 0.73. 
AG) —:| —0.50 |. 
—0.46 


We can find the third eigenvalue of the given matrix knowing 
the trace of the matrix; since А, + à, +- 4, = TrA = 3 + 2+ 
1 = 6, it follows that А, = 6 — 3.858 — 1.398 = 0.744. Д 


Exercises 


1. Use the method of direct expansion to find the ch..racteris- 
tic polynomials of the following matrices: 


20507 47% 123 
(a) А-|6 3 4], (9 а 2 , 
52223 8 —3--2 1 
9 3—3 —1 2 
44144 14 
1024-1-14 
() A—|4 4 1-4 
4-4-1 4 


2. Find the characteristic numbers and eigenvectors of the 


matrices 
.» —3 
34 
(а) А- (МА-|-40 1l. 
[52] | 12 El 
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3. Use Krylov's method to expand the characteristic determi- 
nants of the following matrices: 


1 2-4 TEM 
(а) А-|3--1 2], (b) A= , 


1 2—5 4 

1 0-4 1-4 2-4 
1-2 4—2 
2-4 2-4 
() А-| | 14.2 2 


-2 —2 4 1 


4. Use Leverrier-Faddeev method to expand the characteristic 
determinants of the following matrices: 


5—4 3 0 2—4 3—2 
| 2 1—2 1 1 0—5 —3 
Ма) A=], 4 4 _,|,.®4=), 1—2 2 
2 1-2 0 0 4—4 —1 


5. Employing the Leverrier-Faddeev method, find the inverse 
matrices for the matrices given in Exercise 4. 
6. Expand the characteristic determinant of the matrix 


2—1 2 
А- 5—3 3 
—1 0--2 


and use the Leverrier-Faddeev method to calculate the eigen- 
vector. 
7. Usethe iterative method to calculate the first and the second 


eigenvalue of the matrix 
41h 
A=|1214], 
011 


Chapter 7 
Interpolation and Extrapolation 


7.1. The Function and the Methods of Its 
Representation 


In practical problems it is often necessary to establish 
relationships between processes and phenomena and to 
describe them by mathematical means. 

Let us consider the relationships for which a certain 
quantity y, characterizing the process, depends on a set 
of unrelated quantities z,, Z}, . . ., Zn, so that every set 
(21, Zos.. тһ) is associated with a single value of the 
quantity y. ‘This unique correspondence between the 
quantity y and the set of independent variables zr, 
Zo, ..., Т, is known as a functional dependence and the 
variable y itself is a function of the variables z,, Z, . . ., 
Zn, the formal notation being 


y=f (ті. 19,0... Zn). 


Thus the expression y = zj + 3V z,--z,zlis a func- 
tion of three variables. 

If the quantity y is a function of one independent vari- 
able z, then their relationship can bc representec as 


y =f (т). 


For instance, the area 9 of a circle is a function of an 
independent variable, the radius R of the circle, i.e. S — 
1 (R); the specific form of this function is 5 = лА?. 
The volume of a figure is a function of three dimensions, 
іе. V =f (z,, z,, =з), and the form of this function 
depends on the shape of the figure. 

Mathematical analysis gives three methods of represent- 
ing functional relations: (1) analytical, (2) graphical 
and (3) tabular. 

The analytical method is most сопу "aient for represent- 
ing the functional dependence y = / (г) since it directly 
indicates actions and the sequence in which they must be 
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performed on the variable z to obtain the corresponding 
value of y. 

Thus, for instance, mathematical means allow us to ob- 
tain the following analytical dependence of goods and 
valuables supplied on credit and the seasonal expenses in 
agriculture on the expenses on the livestock, i.c. 


y = 51.0203 + 0.1059 =, 


where y constitutes the credit against tlie goods and т 
constitutes the ex penses on livestock. 

Here is another example of analytical dependence: in 
a uniformly accelerated motion, the path traversed and 
the time spent are related as 


s = vt + 0.5 at. 


The advantage of the analytical method is the possibili- 
ty of obtaining the values of y for any fixed argument = 
with any degree of accuracy. 

The drawbacks of this method are the necessity to carry 
out the whole sequence of computations and the lack of 
visuality. 

These drawbacks are obviated when we use the graph- 
ical method of representing the function y = f (z). 

The graph of the function y = f (г) is the set of points 
of the zy-plane whose coordinates satisfy the equation 
у =f (2). . 

The tabular method ої representing functions is widely 
used in engineering, physics, economy апа natural 
sciences (and is often nceded in experiments). 

Assume, for instance, that as a result of an experiment 
we have obtained the dependence of the ohmic resistance 
R of a copper rod on the temperature t in the form 
of a table: 





R 71.80 78.75 80.50 82.35 83.90 85.10 




















e | 25.0 | 30.1 | 36.0 | 40.0 | 45.1 | $0.0 


In this experiment the value of the ohmic resistance of 
the copper rod varies with temperature and is a depen- 
dent variable. 
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The advantage of the tabular method of representing 
a function is that for every tabulated value of an indepen- 
dent variable we can immediately find, without any 
measurements and calculations, tlie corresponding value 
of the function. 

The drawback of this method is thal we cannot define 
the function completely, i.e. there are always values of 
the independent variable which are not included in the 
table. 


7.2. Mathematical Tables 


There are functions often encountered in mathematics 
whose calculation, despite the seeming simplicity, is 
very cumbersome. These functions are usually tabulated, 
i.e. represented as mathematical tables. 

Tables of Zanctions of one variable are especially widely 
used. These are tables of inverse numbers, of squares and 
cubes of numbers, square and cubic roots, tables of loga- 
rithms, tables of trigonometric functions, tables of expo- 
nential function and of other elementary functions. Tables 
of functions of two aud several variables are also formed. 
The table of products of (wo numbers is an example of 
a table of functions of two variables. 

The table is a collection of values of a function for 
the sequence of values of Lhe arguments zo, ty. Zar» . ., Ene 
It must include a collection of values of the argi:ment 
such that for any values of the argument differen. from 
Zos Ly, 2),...,1,, We can obtain the value of the function 
with the necessary degree of accuracy. 

The principal characteristics of the tables are: (1) the 
names of the functions whose values they express, (2) the 
volume, (3) the step, (4) the number of symbols of the 
tabulated function, (5) the number of entries. 

The name of a function whose numerical values are tabu 
lated is the analytical expression of thal function, say, 
sin т, Іов г, ех ete. 

The volume of a table is delined by the initial and finite 
values of the argument. Thus, for ins! ince. the volume оѓ 
the table y = sin z envelopes the values of the argument 
from 0°0’ to 90°. 

For almost all tabulated functions the values of the 
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Table ?.1 
Radtans Degrecs Raditans Degrees Degrees Radians 
а) (2) (3) (4) (5) (6) 
0.20 11.459 0.70 40.107 20 0.34907 
21 12.032 74 40.880 24 36652 
22 12.605 72 41.253 22 38397 
23 13.178 73 41.826 23 40143 
24 13.754 74 42.399 24 41888 
1 
Continued 
Degrces Radians Minutes Radians | Minutes Radians 
(7) (8) (8) (10) | (11) (12) 
70 1.22175 20 0.00582 5n 0.01454 
71 23918 21 00621 51 01484 
72 25662. 22 00640 52 04513 
73 27409 23 00669 53 02542 
14 29151 24 04698 54 01571 


argument ір the table form ап arithmetic progression, 
whose common difference h is known as the step of the 
table. Thus, 


h = zi — 1,1 = const (i = 1, 2, ..., n). 
Then 
zi = То + ih (i = 0, 1,..., n). 


As an illustration, let us consider a fragment of the table 
of conversion of radians into degrees and degrees into 
radians (Table 7.1). 

In the first two columns of the table the radian measure 
is an independent variable and the degrees are its function. 
The same is true of the third and the fourth columns. The 
value h = 0.01 radian is taken here as the step of the 
table. 

Beginning with the fifth column the inverse of the given 
function is considered, where degrees (or minutes) are 
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taken as an independent variable and the corresponding 
radian measure is a function of the degrees (or minutes). 
The step of this part of the table is equal to one degree (in 
the fifth and the seventh column) and to one minute (in 
the ninth and the eleventh column). 

There are also reference tables which have a complicat- 
ed two-level step. Down the column we lay ой the values 
of the argument with a relatively large step Àh*:z, = 
Zo + ih* (i 0, 1, ..., n) and the corresponding 
values of the function y; = fi = f (zi). Across the table, 
in the first row, we put the values of the argument with 
a liner step А, usually equal to a tenth of the large step: 
h = 0.1h*. Тһе second and the subsequent rows include 
the values of the function for an argument equal to the 
sum of the values z; which are іп the row and the column 
whose intersection is the value of the function. Thus, 
Table 7.2 is а fragment of the table of cubic roots from 
which it is easy to determine the large step down the 
column, A* = 1, and the fine step across, k = 0.1. 

The step of a table is usually expressed as a digit of 
some decimal place (less frequently as two or five digits 
of a certain decimal place). For instance, in the tables of 
squares, cubes, of square and cubic roots, in the tables of 
logarithms the large step h* = 1, in the tables of natural 
logarithms and the tables of inverse numbers the large 
step Һ* is 0.1 (sec Table 7.2). 

lf we consider the table of sines (Table 7.3), the large 

step in it is one degree and the line step is equal to six 
minutes. 
” The next characteristic feature of a table is the number 
of symbols of the tabulated function since the values of the 
function y — f (x) for the tabulated values of the argu- 
ment in mathematical tables and the results of measure- 
ments in engineering tables are approximate values. Only 
valid digits of the numerical value of a function are 
entered in a table. ‘This means that the error does not 
exceed five units of the lirst dropped decimal place. The 
values of the function for all values of т presented in the 
table are determined with the same absolute error. The 
accuracy with which the values of the tunction are given 
in the table is the accuracy of the table. Sometimes the 
accuracy is diflerent in different parts of the table. 
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ln some cases, when we work with tables we must know 
ihe differences of the neighbouring values of the function 
given in the table, i.e. Yia; — y;. These differences are 
known as the first-order forward and backward differences 
and аге sometimes written in the column of the func- 
Lion between its values which take part in the formation 
of the corresponding finite difference. The differences are 
written. in the units of the last decimal place without 
zeros in front of the significant digits. and without the 
decimal point. For instance, in the table 





x | SIn x 
1.000 0.84147. ., 
1.004 0.8426] OF 


the йи. dicrenee 0.000504. -= 0.84201 --0.84147 ік writ- 
ten between Lhe corresponding values of the Function, 

The number of entries is the next characteristic feature 
of a table. Ht is equivalent to the number of arguments of 
the function. Thus the tables for functional dependences 
yous f (т) are tables with one entry. Fables 7.1, 7.2 and 
7.3 given above are of this kind. 

The tabulation of a function of two variables z =- J (x, y) 
leads to a table with two entries. Multiplication tables 
are the most widely used tables of this kind. 


| | 


М 








5 : 9 

541 1082 1623 | 2464 | 2705 | 3246 | 3757 | 4328 | 4869 
542 41084 | 1626 | 2168 | 2710 | 3252 | 3704 | 4336 | 4878 
543 1085 | 1620 | 2172 | 2715 | 3258 | 3801 | 4344 | 4887 
544 1088 1632 | 2176 | 2720 | 3200 | 3808 | 4352 | 4896 
545 1090 | 1635 | 2180 | 2725 | 3270 | 3815 | 4300 | 4905 





Jn Table 7.4 the three-digit multiplicand is written in 


the left column and one-digit mulliplie is written in the 
upper row of the table. The step of both entries is equal 
to unity. To obtain the product of a three-digit number 


19—0104 
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by a one-digit one, it suffices to find the row whose first 
column contains the multiplicand and choose the column 
containing the multiplier. The required product is in the 
row and columns obtained. 


Example 1. Wo have to multiply 543 by 8. In Table 7.4 we 
find the row with 543 in it and the column numbered 8. At their 
intersection we read the number 4344, and this is the required 
produet. 


To multiply multi-digit numbers, we divide tho multi- 
plicand into parts containing not more than three digits 
and apply the technique described above to each part. 


Example 2. We have to multiply 541 544 by 37. Wo divide the 
number 541 544 into two three-digit parts 541 and 544. Thon we 
successively multiply each part by three tens and seven unities and 
add the resulting partial products together: 


541 х 30=1623) 544 X 30 — 16 320 
541 Х7 =3 787 544X 7 —3808 


20017 20128 


We place the first partial product three decimal places to the left 
of the second product and sum up: 


20 (M7 
+ — 320428 
20037128 | 


And this is tho required result. 


When you work with tables, please remember thal there 
may be peculiarities in their arrangement. Therefore, when 
using a reference book for the first Lime, gel acquainted 
with its description. 


7.3. The Approximation Theory 


The theory of the approzimation of functions and its 
practical applications are usually needed in problem 
solving. 

Assume, for instance, that in the process of an ехрегі- 
ment, at the descrete moments zp, 21, . • ., zy ме obtained 
the values fos fis - - ., fy of a quantity f (т). We have to 
reconstruct -the function f (т) for other z Æ х, (i — 0, 
1,..., М). Asimilar problem may arise when we repeat- 
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edly compute one composite: function. f at different 
points using а computer. Instead of doing repeated 
computations, it may be expedient to calculate the 
function f at a small number of characteristic points т; 
and calculate its values at other points employing a 
simpler rule with the use of the values f; —/(r;) already 
known. 

The problems of finding the derivative /' (с) and the 

b 


integral V (г) dz from the given values f; can be cited 


a 
as other well-known examples of approximation of 
functions. 

Finally, the problem of approximation of functions also 
arises when algorithms of standard programs for caleu- 
lating ciementary and special functions are set up. 

The elas. ical approach to the solution of these problems 
requires the use of the data on hand concerning the function 
J in order to consider another function q which is close, 
in а certain sense, to / and which admits of the requisite 
aclion on it, thus allowing the estimation of the error of 
such an “analytic substitution”. 

In the process of numerical realization of this approach, 
iL is necessary Lo consider four principal problems. 

1. The problem of the available information concerning 
the function f, i.e. the form in which the function f is 
given. 

2. The problem of the class of the approximating func- 
tions, i.e. of the functions q by whieh the function f 
will be approximated. 

3. The problem of the closeness of the approximated 
and the approximating functions, і.е. of the choice of the 
test of goodness of lit. which the function q must satisfy. 

4. The problem of the error. i.c. of the estimation of the 
difference of the exact and the approximate valuc. 

There are two principal cases in the problem of the data 
on the function f: either the function is delined analytical- 
ly or it is tabulated. The graphical method of represent- 
ing a function refers either to the first or to the second 
case according as the specific problin posed. In what 
follows we shall consider, on the interval (а, ^], func- 
tions f (х) which are continuous together witha sufficient 
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number of their derivatives and defined by their values 
f; = f (г) at the nodal points of the given net 


Ам: {а ж ay... Cay}. (1) 


As concerns the class of the approximating functions, 
we musl proceed here from two main factors. First, the 
approximating function must reflect the peculiar features 
of the function being approximated and, second, it must 
be convenient enough to be manipulated, i.e. admit of 
various actions performed on it. 

In numerical analysis wide use is made of three groups 
of approximaling functions. The first group includes 
functions of the form 1, ,..., z", whose linear combina- 
lions generate a class of all polynomials of degree nol 
higher than n. The second group consists of trigonometric 
functions sin ат and cos ajz which generate the Fourier 
series and the Fourier integral. Finally, the third group 
consists of exponential functions o*i* which define phe- 
nomena of the type of decomposition and cumulation often 
encountered in reality. 

Later on we shall consider in more detail the polynomial 
approximation, і.е. we shall take a polynomial of a de 
gree п as the approximating function. 

іп this case the approximating function is usually de- 
signated as P, (2) and has the form 


п 


ф(х) = P, (х) := У) aya". (2) 


h==0 


The problem concerning the lest of goodness of [il 
consists essentially in determining somehow the “dis- 
tance” between Ше approximated and the approximating 
function and choosing, from the whole class of approxi- 
maling functions, the function for which this "distance? 
is minimum. 

Chebyshev's method "of fitting" is the most frequently 
used test of goodness of fit. Ll is based on the concept. of 
the dis. ance as the maximum value of the deviation of the 
function ф from the function f at the nodal points т: 


p= max |/(r;))— e (zi) |. (3) 
< 


515 
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Of especial interest is Ше special case when the distance 
pı == 0 for the approximating function. This means that 
for the tabulated function y = f (x) defined by its values 


Jj, == f. = f (ш) 


т | Ti | -- | IN 


we have to construct an approaimating funetion q (г) 
which coincides, at Uie nodal points c, with the values of 
the given function y -= f (à), іе. such that (а) = gi. 





This method of approximation, based on the test [or 
goodness of fit of / and q al the nodal points e, is kuown 
as interpolation. M the argument a for which the approsi- 
male value of the function is sought belongs to the inter- 
val Lry cyl, then the problem of finding the хана of the 
function at the point a is called citerpolation in the arrow 
sense. Now if the argument « is outside of the interval 
lra tyl, then the problem posed is called extropolation. 

In terms of geometry, the problem of interpolation for 
a function of one variable y = f (7) means a construction 
on the ay-plane. of a curve which will pass through the 
points with coordinates (zy. Yah (tie yi) oe ee (ту. Уд) 
(Fig. 7.1). 

Here is one more example of the test of goodness of lit. 
We inroduce the concept of the distance between the func- 
tions f and q as the sum of the squares of their deviations 
al tlie nodal. points: 


N 
p № Heppen. (6) 
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Now we choose, as the approximating function, the func- 
tion for which p is minimum. It is expedient to use this 
test when information is plentiful but is specified with 
а low degree of accuracy. The method of approximation 
based on this test is often called the method of the least 
squares. The advantages of this method are its simpli- 
city and the order and harmony of its mathematical 
theory. 

And now the last problem, Lhat, concerning the accura- 
cy of the solution obtained. In many respects it is the 
main problem. Indeed, in the final analysis the quality of 
a method depends primarily on the speed of obtaining 
a result with the required accuracy, or, as wo say, the 
rale of convergence. It is therefore evident that the choice 
of the nodal points, of the class of approximating func- 
tions and of the test of goodness of fit must serve one pur- 
pose, the required accuracy. 

At first glance the problem of the accuracy of the solu- 
Lion seems to be very simple: the approximate solution 
must differ from the exact one by not more than the 
specified e. However, the question of the possibility of 
arbitrarily close approximation of the function /, which 
depends on the "parameters" enumerated above (the nodal 
poiuts z;, the class of functions 4, the test of goodness of 
lit of f and ф) remains open in the general case and must 
be investigated for every specific process of approximation. 


7.4. Interpolation by Polynomials 


Let us consider in more detail the problem of interpo- 
lation of the functiou / by algebraic polynomials. 

In this case the approximating function « is usually 
designated as P, (т) and has the form 


9 (z) e Р, (2) = 2) apa". (1) 


The choice of the specific value of n depends, іп many 
respects, on the properties of the function being approxi- 
mated, on the required accuracy and on the interpolation 
nodes. We shall see later on that. the choice of the quanti- 
ty н is affected essentially by the process of computation 
which may add an error to the result, 
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The condition of coincidence of f and «q at the nodal 
points is evidently assumed to be the test for goodness 
of fit. 

It is natural to assume that for an unambiguous deter- 
mination of n -|- 1 coefficients а, of the polynomial P, it 
is necessary to require Lhe coincidence of f and P, al 
the (z -\- 1)st nodal point: 


f(x) = Р, (к) (із-0,1,..., n) (3) 


The polynomial P, (г), which satisfies conditions (2), 
is known as an interpolating polynomial. 'To emphasize the 
dependence of this polynomial on the function f, it is 
often designated as Р, (f, г). 

The error of interpolution A, in the case when it is 
necessary to calculate the value of the function f (z) at 
one point c*, is understood to he the absolute value of the 
difference oz іле exact and approximate values: 


Ay = | f (4) — Pa (2*) |. (3) 


But when the interpolation is carried oul on the whole 
interval а, 21, the maximum deviation of the polynomial 
P, from the function f on the interval in question is 
assumed to be the error: 
Ay -= max { f(r) — Р, (2) |. 
[2,5] 

Let us consider the following interpolation problem. 
The values f, = f (z,) ( 0, 1,..., т) of the function f 
are specified on the net Ay! aso ay др... oe, SD 
at the nodal points тү. We have to construct an interpolat- 
ing polynomial P, which would coincide with f at the 
nodal points .r, and estimate the error А. 

The existence and uniqueness of the interpolating poly- 
nomial follow from the theorem given below. 


Theorem. Jet: (1°) a net Ас а< т m m... < 
ly <b is given on the interval (а, b]. and (2°) arbitrary 
numbers c, (i = 0, 1, ..., п) are specified. Then there is 


a polynomial Р, of degree not higher than n, which assumes 
the assigned values c; at the nodal points z,. and this poly- 
nomial is unique. 

' [From the conditions for determining the unknown 
coefficients a, of the polynomial P, we obtain a system 
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of algebraic equations 
agri -|- а-к... 0, = 6 (i 50, 1, ..., n). (9 


The determinant of (his system 


n m-i T 
ту у... % 1 
n pi-i 

W = 2, TQ ту 1 (5) 
n pgn-i 
aR Ni... Tni 


is a Vandermonde determinant which, as is known from 
algebra, is nonzero if the condition 2, = w; is satisfied 
for i = j. This condition is evidently fulfilled for the net 
A, being considered. Consequently, system (4) has a uni- 
que solution (a unique collection of coefficients a,). MI 

It is evident that if we take the values /, of the func- 
tion f at the nodal points x; as the number c,, we shall 
obtain а statement on the existence and uniqueness of the 
interpolating polynomial P, (f, г). 

The coefficients а, of the interpolating polynomial (1) 
can be found by setting c, = f, in system (4) and solving 
the system: using, say, Cramer's rule: 


ак = АИ. (6) 
Here А, is a determinant obtained from iV as a result of 


the subslittdion of the column f, of the constant terms of 
system (4) for the column of terms containing the (x — A)th 


power of z; (і = 0, 1, ..., п): 
СЫМЫ 
n ге h-F1 rn h--1 
тү... wel 
А, = |" h (7) 
г... rt Она in giochi ...1 


Substituting the values of a, obtained into relation (1), 
we arrive at a new form of representation of the interpo- 
lating polynomial P, (f, 2): 


P, ix т 
fo 17028) 0), (8) 


n 
Ín 1 отут 
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Note that in praclice we usually use interpolating poly- 
nomials of the first and the second degree. And then we 
speak of the linear and quadralic interpolation. 

Example. Using the nodal points zo, тү, т, and the corresponding 
values fos fi» fa of a function, construct an interpolating polynomial 
representing it as a linear combination of the values f; (+ — 0, 
1, 2). 

А According to formula (8) we have 


Р,1 т x 


fo | T9 22 


hod ri 
fy dom, 23 
Expanding the delerininant according lo (he elements of the first. 
column, we obtain 


| 7$ 2 1: r de а? la а? 
Pa| lay r? hd orn et БИЛ tty ао fa] L ro АҢ -40. 
ТЕТЕ Га, 2$ lr, 43 БЕРЕН 











Taking into account that 
1n 43 
{aj Ee (Qe ri) Gud Gao 1p. 


1 Sh th 


we finally obtain 





(rand pp 0 e ora 
UE Де Den) (40-75) ! (ty to) (at) 
Lf, (roro) (7 =) -A 


“(ty — to) GO — гу) 


7.5. The Error of Interpolation Processes 


Assume that the function f is approsmmated by an 
interpolating polynomial, i.v. 


/ (г) P, (4) i aR, (ч), (1) 
where /0, (е) is the remainder of the interpolation for- 
mula 


f(r) ге P, (т). 2) 


The remainder depends on many Т.сПоғ such as the 
properties of the function f. the interpolation parameters, 
the position of the point of interpolation. Therefore the 
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study of R, (2) is a difficult problem. First of all we must 
estimate the error. If the point of interpolation z* is 
fixed, then it is natural to take the quantity A, = 
1А, (z*) | as the estimate of the error. Now if the 
point z* is unknown and the interpolation is carried out 
on the interval [a, 5], then it is expedient to take the 
quantity 

А, = шак ГА, (т) | (3) 


as «slimate of the error. 

Other estimates of the error can be chosen depending 
on a specific problem. 

As a rule, the estimate of the error is sought not for 
an individual function but for a whole class of functions 
with some common properties. 

We shall derive an explicit expression to estimate the 
error (3) of the interpolation formula (2) for the class of 
functions C"*! (а, b) which have a continuous derivative 
of order п: -+ 1 on the interval [a, b]. 

For this purpose we prove the following theorem. 

Theorem. Assume thai: (1°) the nodal points x, (i = 0, 
1, ..., п) are distinct and belong to the interval fa, b) 
together with x*, (2°) the function f has a continuous deriva- 
tive of order n -- 1 on [a, b]. Then there is a point E Є (a, b) 
such that 


(ан) (E 
Р, (2 х*) =: - d Am Пе * — т). (4). 


ONote that if z* coincides with one of the nodal points, 
then relation (4) is satisfied since its right-hand and left- 
hand sides are zero. Therefore we shall assume in what 
follows that z* 3& z; (i = 0, 1, ..., п). We shall consi- 
der an auxiliary function 


(a= а) Palak f] e—a) 09 


where k is a constant chosen such that the function Ф 
уапізһез at x = z*, i.e. 


V (z*) -0— f(z*) — P, (29k || *— 29. 
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Hence 
k-- f (2*) -- Pn (2*) _ __ Rn (2*) 


n т (6) 
(а-ә) [| G*—20 
4—0 1-0 
By virtue of such a choice of k the function V vanishes оп 
the interval (а, b] at least n | 2 times at the points z, 
Hy very Lay r*. Then, using b) he theorem, we can 
state that in the interval (a, b) the derivative V' van- 
ishes at least n + 1 times, the derivalive Y" vanishes at 
least n Limes, and so оп, up to the derivative VC *D which 
vanishes at least at one point, say, at the point Е € (a, b 
Differentiating now the right-hand and left-hand sides 
of relation (5) n -}- 1 times with respect to z and then set- 
ting z = Ё, we get zero on the left-hand side since 
wel) (£) 2 0. The first term on the right-hand side 
yields the value of the derivative at the point 5: 7 * (€). 
The second егт on the right-hand side yields zero being 
a derivative of order n -|- 1 of a polynomial of degree not 
higher Шап л. The third term is the product of the con- 
мапі k by a polynomial of degree n + 1 with the leading 
coefficient 1; the derivative of order n 4- 1 of this poly- 
nomial is evidently equal to (n + 1). Thus, summing 
up all we have said above, we have 


0 = +0 (Е) — k (n -+ 1) 
Replacing A in this relation by its expression (6). we gel 
the required relation (4). MI 
Assume now for definiteness that 
| fe» (т) | Maas, г € fa, bl. (7) 


Employing this restriction and the theorem we have just 
proved, we arrive at the following estimate of the error 
for the fixed point *: 


Mn. 
A,— | B, (2% )|< СЕП П | 0 — (8) 
It is now easy to construct the estimate | A, |, uniform 
throughout tlie interval fa, b), for the fixed net A,, namely, 


Mns max | өл (2) 1, (9) 
(а, 


А, = R, 
‘ шах | (ғ) | mL 
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where 


о, (2) - Й («—2). 


Example 1. On the interval [—1, 1] get a uniform estimate of 
the deviation of the function f= 1 — cos (12/2) from its interpolat- 


ing polynomial constructed on the nodal points z; = — 1 + 2 


((—0,1,..., n, n = 2, 3, 4). 

A Note first of all that for the function undor consideration 
My +, = (2/2)?! on the specified interval. Therefore, by virtue of 
estimate (9), the solution of the problem reduces to the estimation 
of the quantity max | о, (x) |. This can be dono according 


[71.1] 
to the ordinary rules of mathematical analysis. 
1. Let us consider the case n — 2. Then 


ва (т) = (z-.l- 1) z(z— 1) (>) = За? - - 1. 


The roots of the polynomial o, (г) are z}, = -t- 1/15 = + 0.5774. 
Substituting the values oblained into the expression for w,, we 
obtain 


max |[о, (2)| = |@, (21)1 =2/ V 27 = 1.3840 
» 1] 
and, consequently, 
m\a 1 2 . 
A x (+) Br ay 5 


2. Let now » = 3. In this case 


os (2) = (0-4 1) (3) (2-4) e 


20 
o, (а) = 4292 т. 


The roots of the polynomial œ; (z) are г):- 0 and 4,37 
+ 5/3 = + 0.7454. It is easy to verify that the maximum 
value | w; (z) | is attained at the points z, and ху: 
max |w; (2) | = [wy (z,)] —= 10/81 = 0.1975. 

1, 1] 


Therefore 


4 
tee (E) de ap anos 


ав = 


3. For n-- 4 we reduce tlie estimate of 


w, (z) = (2+ 1) (2+ т) т (-:) («— 1) 
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to the estimate obtained in item 1. Indeed, since о, (г) is odd, we 
may only find the maximum value of | в, (т) | on the interval |0, 1]. 


In this case 
1 
т (:--) е0. 


Using the formula z — ; (y 4- 1) to change the variable on the 


right-hand sido of the relation obtained and taking into account the 
results obtained in item 1, we get 


3 
max |в, (z)| «2 “7 * max 
[0, 1] 10, 1] 





3 max 
[0, 1] 





1 3 
* (z -у)@—0]=-у шак 10-0) ни 0) 


| 1 
1778 





ex 0.1443. 
Thus 


max | [e (z) <1/1/48 = 0.1443 
[41 


and the required estimate 


X 9 1 1 
А, < (+) СҮН —(0,42. А 

This example seems to substantiate the assumption 
Lhal estimate (9) is practically suitable and assumes small 
values for the majority of functions for sufficiently 
large n. Iiowever, in many cases this is not so. 

The matter is that only for a small class of functions 
(say, for entire functions) the derivatives of sufficiently 
high order are smail, but for the majority of functions 
some of higher-order derivatives have a tendency of grow- 
ing as n!. As ап example let us consider the function 
y = 10 к. For this function, evidently, y™ = 





(1)? (nn Thus even in the vicinity of points 


where the curve y = log г seems lo he smooth its deriva- 
lives of sufficiently high orders become very large and 
behave as vt. 

The drawback of polynomial approximation is the ab- 
sence, as a rule, of a physical meaning which usually leads 
to useful generalizations. 

On the other hand, the simplicity and the thorough 
development of tho theory of polynomial approximation 
in conjunction with the minimum of computations make 
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this kind of approximation a convenient tool for solving 
various problems, all tho more so as the experience of 
practical computations leads to good results of approxi- 
mation by polynomials although either it is difficult to 
estimate the remainder or its estimate is too high. 

We have thus considered only one aspect of the problem 
concerning the error, the effect of the properties of the 
function f on the quantity A,. The problem of the depend- 
енсе of the error on the arrangement of the nodal points 
of the net is closely connected with the properties of 
Chebyshev's polynomials and, therefore, we shall return 
to the study of this problem after we consider these poly- 
nomials. For the time being, wo shall restrict our consid- 
eration to one of the possible estimates of the quantity 
| ә, (х) | on the fixed net A,. Let z be between с, and 


ізі, We set max (2, — 2:1) = h and then 
1<i<n 


n 
lon (а) 5 [| Ee z p CE D! (n= k)! hH т"! 
4-0 


(10) 

We сап therefore write inequality (8) in the form 
__ Маһ nat 42 
A= max | Ry (2) |< PER “ ( ) 


Note that estimate (10) is rather rough and can be casily 
improved (do it independently as an exercise). 


Example 2. With what accuracy can we calculate үлт using ап 


interpolating polynomial for the function y — Vz, taking Ta = 
100, z, = 121 and т, = 144 asthe nodal points of interpolation? 


A First of all we determine M,= max (И 2)"|. To do 
[100, 144] 
this we find 


yoyo, y= 2ч, y= zc, 


Hence M, = 100-872 = tcs, Therefore, on the basis of 


relation (8) we have 


Aix i tirer 1(117—100) (117 —121) (117—144) | 20.12.0172. А 
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7.6. Lagrange's Interpolating Polynomial 


А direct determination of the coefficients а, of an 
interpolating polynomial encounters some computational 
difficulties. Therefore, when we solve practical problems, 
we deal with special kinds of an interpolating polyno- 
mial. 

In this section we consider tho form of an interpolating 
polynomial which is known as Lagrange's form and is 
usually designated as L, (т). To construct L,, we shall 
first consider auxiliary polynomials J; (г) of degree n 
which possess the following two properties: 


1, (zi) = 1 (i = 0, 1, 4... п), (1) 
lı (za) = 0 (ik i, kh 0, 1, ..., n) (2) 


These properties mean that, for instance, the polynomial 
ly (т) assumes a value equal to unity at the point л, 
and vanishes at the other nodal points; J, (г) assumes 
a value equal to unity at the point r, and vanishes at the 
other points and so on. In the general case, the polynomial 
l; (z) assumes a value equal to unity at the nodal point 
2; and vanishes at the other points. Thus, by virtue 
of property (2) and the requirement that the polynomial 
lı (z) should be of degree n, we obtain 


1 (z) = с (0)... (а) (= н)... 
.. (£ аа). (3) 
Furthermore, using property (1), we have the following 
equation for determining the conslant сы 
li (x1) = Ci (Zi — 20... (£i — 9i) 
x (zi — 7141). .. (2; -- та) -- 1, 
From this we have 
1 
а, 4 
7t тту... (та) (трт)... (Ci En) (4) 
We can therefore represent the explicit expression for 
lı (т) as follows: 


06229) (2—10) (EHF) (Fn) ^ — (n 
lh (2) == (Ti — To) ..- (20—201) (Zi — +)... (0—2) ` e 
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Let us now set up the following linear combination of the 
polynomials 1: 
п 
L, (г) = 2, fili (т). (6) 
i= 
Expression (6) is a polynomial of degree not higher 
than n. At the nodal point z; this polynomial assumes 
the value f; since the corresponding term of the sum 
fil, (zi) is equal to f, and the other terms of f;l; (г) are 
zero. We have thus constructed an interpolating polyno- 
тігі for the function f (т). This form is known as Lagran- 
ge's interpolating polynomial. 
Taking into account that 


Wn (х) = (т — Ta) (£ — 7)... (© — гь), 
we can consider ils derivative at the point т: 


On (ti) = (ті — 4). . (Ti — Tia) (ri — Tip). .. 


oe (ni — n) 
and write Lagrange’s polynomial as 
n 
өл (т) - 
La (2) = Di fi Aer)" (7) 
4гг0 


The quantities l; (г) are the weight polynomials of the 
corresponding nodal points and are often called Lagran- 
ge's multipliers, In addition to properties (1) and (2) we 
shall consider one more imporlant properly of these 
multipliers: 


2 lj (z) — 1. (8) 
Indeed, assume that f (r) = 1, and then all f; = 1 (i = 0, 
1, .. ., n). On the other hand, f/"*D (г) 20 and, by 


virtue of the theorem presented in 7.5, / (т) = f (x) = 
1. Substituting the expression obtained inlo (6), we 
arrive at relation (8). 


Example 1. Using the nodal points т, = 0, z; = 1/3and т, = 1, 
construct Lagrange's interpolating polynomial for the function 
f = sin (12/2) and get a uniform estimate of the error on the 
interval [0, 1]. 
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A Note first of all that f (rj) = 0, f (т) = 1/2, Í (z3) == 1. 
'Then, using expression (7) for п <= 2, we consiruct the required in- 
terpolating polynomial: 

1 
z (r— 1) +4 т (:-ҙ) 


1 [1 ! Тү: 
3-1) 1 (173) 

lt is easy Lo obtain the estimate of the error from rela- 
tion (8) given in 7.5 for n = 2: 


Ma —4)(— 
ALT тах |2 (= 3 ) (т t). 


1 
Ly (т) = > 


In this case, evidently, М, -– (л/2)3 and max |z (= — 
[0, 1] 
3) (7 — 1)1- 0.079 and we can determine it in the same 


way wo did it in Example 1 of 7.5, Therefore the final 
result is 


A( x) 40.079 0.05. A 


Example 2. The function f (г) is tabulated as follows: 
I | ü | 1 | 2 | 6 
y | -4 | -a| 3 [us 


Using Lagrange's interpolating polynomial, we find its value at 
the point z—4. 
^ Substituting,the values of r; and f; for n = Запіс- 4 into 
formula (7), we ohtain 
(4- -1) (4—2) (4—6) , A(4- 2)(4- -6) 
Ly (4) = 1 A A eg Аа т. 
(--1) (—2) (— 6) 1(1—2) (1—6) 
4 (A -- 1) (4--6) 4(4- 1) (4—2) 


sede 117577861) a 





—255. A 


И we add one more point to the table in this example, 
we must caleulate the value of the function for 2 = 4 anew. 
Desides this, it is seen from the example itself that the 
process of approximating the function with the use of 
Lagrange’s formula is connected with long calculations. 
This generates a need 10 simplify the computations. 

To make the computations easier, we compile the 
following table. 


20--0104 
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2-1; | z 20-1 | Т0-1% |- [а — Zn | ko 
11 — To | ї1— 11 | 21 —- 29 Е l^ T1— Tn ^ ky 
Zg— To | 24-1) | I— T9 Е Zu — Zn | 5 
Zn— fg mh |= --- £1 | ғ n— 53 [- | 2-1, “ы kn 





where Zo 21,2... TQ аге the interpolation nodal points 
and z is the value of the argument for which we determine 
the approximate value using Lagrange's interpolation 
formula. We designate the product of the elements of the 
first row as ky: 

ko = (£ — To) (Ту — у)... Wo — tn). 
In the general form, the produci of the elements of the 
ith row. is 
Ay = (£i — 20)... (Zi — ti) (г — т) 

x (7; — ғын) we (ri — Xa). 
We place the numbers ko, kis . . ., Ay in the extreme right 
column of the table. In addition we calculate the product 
of the elements which lie on the principal diagonal: 


(r — гъ). 


Then we can rewrite Lagrange’s interpolating polynomial as 


On (х) = (£ — го) (т— ту)... 


т 


Ly (2): - ө, (2) У) d . 


i-ü 


(9) 


Using formula т we solve Example 2 anew, We compile а table 














4 a] - -4 -2 | -6 | —48 

EN 4—1 E 1 | 6 | 15 
2 әд: 2-1 а |] «€ 4-2 | 2-6 | -46 
6 [| 6-4 | 2 | 46 |  -2 


and find that ө, (4) = — 48. The approximate value of the func- 
tion at the point z — 4, i.e. f (4) œ Ly (4), can be found from the 
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formula 
3 


Ls (т) = Wg e 2k , 


ог 
1487 
£a 4) = —48 [ —Á- -48 5748. а - <r | aa ЕЗ» A 


Lagrange's КЕКТІ formula is noticeably simpler 
when the interpolation nodal points are equispaced, 
i.e. A = £44, — 2; = const, where is the step of inter- 
polation. We introduce the designation t = (г — z,)/h. 
From formula (5) we have 

, = (ar) — (т— т)... (z— zii) (z— z144) ... (£-— 78) 
(Ti — To) «(zi zi Gio zia) ee (i Tn) ^ 
Since 
ж — T = th, 
z — тр = dh —h =h (t —1), 


x — gr, — th — ih — h (t — i), 
то--т„ — th — nh — h(t —n), 
it follows that 


| t(t—41) ... (t—i-4-1) (t—1—1) ... (п) h” 
U^ hG ih... JA(—1)h ...| (n -i) h] 


Note that a part of the product in the denomin. "оғ is 
ih (i —1)h...h =i! h? 
and the other part is 
(—A)...[—(n—i) h] S ( — 1)! (n— i! n". 
Multiplying the numerator and denominator on the right 
hand side of relation (10) by (— 1)" (¢— i), we obtain 
t£(—1) ... (t—n) 


(10) 


hi (t—1) il (а 1) (= 1)" 
п 
n- (%) t(t—1).. (t—n) 
(Ор, 
! 
where (1) = uo РГ 


10% 
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Then Lagrange's interpolating polynomial for the equi- 
spaced nodal points of interpolation сап be wrilten as 


Lp (2) = Tin (т, t) LEED) 


х У (уч 6) Yi. (11) 
1—0 


Example 3. The function у = sin z is tabulated as 
т | 0 | л/4 | 1/2 
y | 0 |о.тот| 


Using Lagrange's interpolating polynomial, find ils value at the 
point z* -= л/б. Estimate the error Л). 


-1 
A We first find 1+ — (4-—) (X) Z, Substituting 


the value of 1% we have obtained and tho values of y, forn- 2 into 
formula (11), we have 


л | (2/3) (2/5 — 1) (2/3- -2) 
ға (FE т )- ) (2/3 — 1) (2/3- :2) 
2 2 


` . ж-- —M а . —т!) 
* Cw " Z3—1i 0.707. WoT 1) 0.517. 


Го estimate the error, wo use formula (8) from 7.5, Tere 
M,.- max (віпт)”|--1, л%--л/6, and therefore 
(8, 5/2] 
..1 zx n A 
3 wu 12 3 


Note that when calculating tlie error we must turn the degree mea- 
sure into a radian one. 

Thus, rounding off the result to two decimal places, we get 
sin (л/0) == 0.52 +- 0.03. А 


=- 0,024. 





7.7. Finite Differences 


In the preceding sections we considered various problems 
of the interpolation theory on an arbitrary net of nodal 
points. In practical computations the information about 
the function (in the form of its values) is often given on 
a uniform net, i.e. for equispaced nodal points. In this 
case, not only the forms of the interpolation polynomials 
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become simpler, bul the computation process is dimi- 
nished, and this is a factor of great significance іп practical 
computations. When constructing interpolating polyno- 
mials on a uniform net, we use quantities known as 
finite differences. 

Consider a uniform net with a slep A: si = гу | 
ih (i — 0, +1, 22, ...), at whose nodal points the 
values of f; = f (rj) of the function f (т) are given. 

‘Three types of finite differences can be encountered іп 
inathematical literature: forward differences A"{;, backward 
differences V"{; and central differences 84, = : f^i. 

A finite difference of the first order is a difference between 
the values of the function at tho given nodal point and 
al the preceding one: 


Һһ-Һ-4% ` VI, — fi. : НЕ 
= fi -АҚ- Vf, ~ бру ~ fares (1) 


fias fo Miss Mae fiu Hauz 


This detnition сап also be wrilten as 


Afi = fils Vf, 70 f, UT li» ôf, 7 Fiam fee (2) 
V finite difference of the second. order is a difference be- 
Iween the values of the hrst finite difference at à given 
nodal point and the preceding оре: 
Nfi- Afi Afo Whi- М-Р, 
9f. А bhi fi. уз. 


Finite «Шегенсен of an arbitrary order. & are delined 
in a similar way: 


Mf, ANY, ы” Af 
vf; vfi NL, (1) 
8%; = fi - BY ыу» - “ТЕТІ 


іп some interpolation formulas ccasidered below, in 
addition to differences (4) we use the arithmetic means of 
the adjacent finite differences of Ше same order: 


(3) 
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T 1 - 
ufi = (бану? fia), utes naf) 5) 


The first of these quantities is used for an odd л and the 
second, for an even ~. 

It is convenient to write the finite differences of the 
function f as tables. In that case the backward and for- 
ward finite differences are writlen as horizontal tables 
(fables 7.5 and 7.6) and central finite differences as 
coulral tables (Table 7.7). 

Let us consider some properties of finile differences. 


Table 7.5 

















т | f | Af | А?) | Аз | Mj 

zo | fo | ^» | аһ | vn | м 
Toth” | һ | Аһ | Mj, | Аз}, | 
n+ | 5 | Аһ | wn | | 
m3» | h | Ms |... | | 
аа л | 
| | | | | 

Table 7.6 

e|] у |] vw | vr | ver |]. ve 
| | | | | 
vul I И 
ea puel] 
та-2Һ | Із | Va | vis | | 
а-в | m | Ча | Уна | Уна | 

а [а | v^ | Үзу; | Үзу; | уз 
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Table 7.7 
= | ¢ | o& [oy | or | ov 
dod omo dod om | 
xul | И НИ 
|] peel ] Б ЕЕ 
wae pe [pee 

| | 6/ | | 63f | 
БЕР | b | | 82у, | | ГУА 

| | ал. | | б | 
wee pa pba 

ЖЕН ЕСІН ү] 
ws] To oTo To o 

| | | | 





©. Forward, backward and central differences are. con- 
nected by the relations 


АЧ,- Ҹар ӧл (6) 


which we can easily prove by induction proceeding from 
the delinition of the ünite differences (4). 

Obor k= 1 relations (б) are obvious since, by virtue 
of relations (4), we have 


Afi- fia Аы fitim fis Shave -- fram fi 


Let now relations (б) hold true for any А ое 1. We 
shall show that in this case they are also valid for k.: m 
and, consequently. for all A. Using relations (4) and the 


assumption on the validity of (6) for АФ m — 1, we have 
А", =- A” fia А", 
а У" fima М fiim 
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Af, = А", А", 
— дт—{ Âm- _. Rm 
=6 fanti 6 HU 6 fy то E 


2°, The finite difference satisfies the equality 
А (af + bg); = a Af, -H b Agi, (7) 


where a and b are constants. 
CJ Indeed, 


А (af + bg); = afia, | bias — (afi + bgi) 
=a А}, 4- bAg,. M 


This property means, in particular, that the finite 
difference of the sum or the difference of (wo functions 
is equal to the sum or the dilference of the finite differ- 
ences of those functions respectively and also that the 
finite difference of the product of a function by a constant 
factor is equal to the product of that factor by the finite 
difference of the function. 

3°. A finite difference is connected with lhe corresponding 
derivalive by a relation 


АЁ} = ВАЎ (8), Ec (x, v; - kh). (8) 


A consequence of relation (8) is that tinite differences 
of order n of a polynomial of degree x are constant. and 
equal to À"nla, and finite differences of any higher order 
are equal to zero (a, is a cocfficient of the polynomial in 
the highest degree of г). 

4°, A finite difference of order k can be represented as the 
following linear combination of the values of fi: 


k 
pk 
А“ = Ж (-1y (7) fiae (9) 
j-0 
where (F) та Л is the number of combinations 


of k elements taken j at a time (with 01 -= 1). 

О Ме use induction. For А = 1 this relation is obvious 
since it is a definition of the first finite difference: Af; 
fiza — fi 


Let now relation (9) hold true for some k = m. Then 
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Af APT А" 
TU 


>) (1P (5) fama D C0 (7) femi 


j=0 j—0 
= (0) ы 200000) (G6) 
mti 
l- (— 1)" " Н 1) А А (- ) ty ("т I " fitmtt-i- 


. т 
We have used the properties of combinations: (, 4) = 


PYF) ame (0) 0) 0 CI) € 
Thus if relation (9) holds true for Æ -= m, then it also 
holds hue fur А = m -- 1. B 


Example 1. Compile а horizontal table ot the finite dilferences 
af tbe function y =- x? -| За -— х -—- 1 proceeding from the initial 
value г = 0 and taking h = lasa step. 

A Sotting cg == 0, c, = 1, 24 = 2, ..., we find the corre- 
sponding values: 

















z | o | 1 13131 4 | 5 
y | 21 | 2 | 17 | 5 | шт | юз | mE 


We seek the finite dillerences of tho first order: 
Ауу = Vic Yo 7 2-6 0 = 3, 
Ay, = ya — yi = 17 — 2 = 15, 
Ау» =: ya — Ya — 90 — 17:- : 83, 
Луз = уа — уз — 107 -- 50 = 57, 
Ay, = yg — уд = 194- 107 = 87, 
Next we seek the finite differences of the second order: 
Aty, = Ay, — Ayo = 15 — 3 = 12, 
АЗу, == Ay, — Ay, =- 33 — 15 = 18, 
A3y, =- Aya — Ау, = 57 — 33 = 24, 
A®y, = Ay, — Дуз = 87 — 57 -- 30, 
And then we find the finite differences of the third order: 
Азу) Ny, Ау - 18 — 12 + ( 
Alyy c5 Аар, = Alyy = 3% IS = б, 
A*y, - Aya — My, = 30-- 24> 6,... 
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We see that the third finite differences A3yo, A3y;, Ау, аге con- 
stant. This can be explained by tho fact that the function f (ғ) is 
a third-degree polynomial. The third finite difference can also be 
found from tho formula 


A" P, (х) == nl agh”, 
i.e. АЗР, (x) == 81.41.19 = 6, and the finite differences of the 


fourth order are equal to zero. 
We compile a table of finite differences: 


x | y | Ay | Aly | Азу | A 
0 —1 3 12 [n П 
4 2 15 18 6 П 
2 17 33 24 0 

3 5! 51 Зи 

4 107 87 

5 104 


In what follows, it is expedient to tabulate finite differences en- 
countered in calculations. A 


Since tlie initial values f; of the funclion are given, as 
a rale, with a certain error в which is the rounding errors 
or random errors, it is advisable to consider the effect 
these factors exert on the errors of higher-order linile 
differences. 

We begin with the influence exerted by random errors 
and (he rounding errors. Assume that we have gol fi pe 
instead of f. Then the table of finite differences assumes 
tlie form shown on p. 315 (see Table 7.8). 

By virtue of relation (9) this means that the error e 
in the difference of order & is extended to the difference 
of order &-|- m with coefficients (—1) ("' 

Now if all the initial values /; are given with the same 
error e, then this error is extended to the differences of 
order m with a coefficient. 2% and grows rapidly with an 
increase іп m (A (T) = 2" e). 

If the derivatives of suflicienlly high orders of the 
function f remain bounded, then it follows from formula (8) 
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Table ?.8 








| | | . 
EI [ 
| кк | | 
" | | nue | 
are | og» 
P e | | fit? —2e | 
[ots | ШЕЛІ 
Қа | | nite | 
| Аны | | 
ЕТЕ БЕН БЕН 





thal the corresponding finite differences /7" decrease wilh 
ап increase in m. Therefore there comes a point where the 
errors of the finite differences resulting either from round- 
ing off or from the errors in the initial data, become com- 
parable with the values of the finite differences them- 
selves or even exceed them. Consequently, the data in the 
lable of these differences will be, in essense, Lhe data on 
the differences of the errors and not the data on the fuu- 
ction and it will not he expedient to use it. [n that case 
we say thal the order of the last finite differences which 
can still be used in caleulations is the order of correct- 
ness of the table of finite differences. 
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, Example 2. Consider a table of values of the Junction /:- 
sin z: 


z 46° | ат | 48° | 40 | эе | St | 52 
/ | 0.7198 | 0.7344 0.7431 | 9.7547 0.7660 | 0.774 | 0. 7880 


АП the digits in the table are correct in the narrow sense. Coni- 
pile a table of finite differences and find the order of correctness of 
Ч. · table. 

A We calculate the finite differences and compile а table. 


Table 7.9 














x | f | n | pon | fs nolo 
46% 0.7193 
121 
479 0.7314 --4 
. 117 3 
48° 0.7431 --1 -5 
116 2 8 
Aye 0.7547 -3 3 -12 
113 1 --4 
50° 0.7060 -2 -4 
TE 0 
54? 0.7771 -2 
109 
b2" 4n. 7880 
4 7 в | 32 





0.00005 | 1 | 2 | 











Note that it is customary to write finite differences in the units of 
the last decimal place of the values of the function, 

The last row of the table contains the corresponding absolute 
errors. Evidently, the absolute values of the third finite differences 
are comparable with their error and the absolute values of the 
subsequent differences are essentially smaller than their errors. 
Therefore the order of correctness of Table 7.9 is 2. A 


The fact that it is inexpedient to use finile differences 
of an ogder higher than two in the example given above can 
also be substantiated as follows. Since the initial data on 
f; are given with an error e — 0.5.10 1, then it is not 
advisable lo take into consideration the limite differences 
which are smaller in absolute value than the errors. On 
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the other hand, using relation (8), we get АҒУ; 2 (л/180)% 
and, therefore, the order of correctness of Table 7.9 is 
defined by the following inequalities: 


(л/180) ->0.5.10:4>> (n/180)" +1, 


which are evidently satisfied for k = 2. 

In the general case, the order of correctness of a table 
of finite differences in this sense is the least value of ~ 
satisfying the inequality 


h1Mayy<e, where М,:- шах | (х) |. (10) 


х Tipy 


We have discussed the influence exerted by the error of 
the initial data on the degree of the interpolating poly- 
nomial, Besides this, if the values f; are approximate or, 
for some reason, the caleulation of the value of the poly- 
nomial P, (7*) cannot be absolutely accurate, then, in 


fact, we get only an approximate value P, (r*) for an exact 
Pa (2%). In that case the error. of calculation of A, (Р): 


| Pa @*) — P, (z*) | is evaluated according to the gene- 
ral rules of calculation of an error of a function, 
Let us consider а Lagrange polynomial! L, (г) = 


ШШ 


| 
D fili (т), for example. Assume that we have to 
) 


= 
саіспігіс Ln (z*) for the given values f; and their errors Е,. 
The values of the Lagrange coefficients 4; (ғ) have been 
labulated for equispaced nodal points and we may con- 
sider them to be exact numbers since they have been. ob- 
tained from the exact values of the nodal points and the 
exact 2%, Therefore we have the following inequality 
for the Lagrange polynomial: 


һ 
Y \1 ; 
А. (Ten) < È e |1; (т®) |. 
ico 
In the case when all g; are the same and equal to e, we 


geL 
т 
% а! 
А. (ba) e X | fp (451. 
і 0 
The caleulalion error for other forms of an. interpolating 
polynomial сап be found in a similar fashion. 
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Example 3. On the interval [—1, 1] get a uniform ostimate of 
the calculation error of the values of a Lagrange interpolating 
polynomial constructed for the function f - cos (д2/2) using the 
nodal points т, = — 1/2, г, = 0, z = 1/2. 

A Since f, = fa = 1/2 = 0.707 + 0.0002 and fs = 1 is an 
exact number, the required computational error has the form 


_ "(а -5 ) (= + ғ) ы 

Ag (La) = 0,0002 | ——À—— — —— —— |4- 0.0002 | 3———————— 
NES (-+-+) (5+5 A 

2 2 2 377 ) °? 


— 0,0004 [ 








(а) |+ (24 4) |]. 


It_is casy to show that on the interval [—1, 1] the quantity 
A, (L) assumes the maximum value al the points 2% — + 1 and, 
therefore, the required estimate is А, (Z,) = 0.0008. A 


7.8. Stirling and Bessel Interpolating Polynomials 


We shall first dwell on the problem of choosing inter- 
polation nodes for a fixed degree of a polynomial which is 
significant from the point of view of an interpolation 
error. Lel us consider an expression for the remainder of 
lhe interpolating polynomial: 


E П (7%-:)), ЁЄ (Lo, ха). 


Since ап interpolation interval is usually not large, Ше 
derivative f+) (х) has a small range of variation. 
Consequently, the range of variation of the value of the 
error is defined, in Ше main, by the product 


т. 
1o, (2%)|- | | |1%-2;|. 
i= 


This value is minimum if the nodes closest to 1% are 
taken as the interpolation nodes. Thus, for an even degree 
n = 2k of the interpolating polynomial we тиз! take 
a node closest to the point 2% and k nodes on the left. 
and k nodes on the right of it, and for an odd degree 
n = 2k +1 we must take k + 1 nodes on the left and 
k 4 1 nodes on the right of the point z*. 

Let us now construct an interpolating polynomial for 
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the function f specified by its values f; at the nodes т; of 
a uniform net with a step А. 

Let the point z* lie close to a сегіаіп node which we 
denote by ry. We have to construct an interpolating poly- 
nomial of an even degree. In accordance with whal we 
have said, we musl take,as interpolation nodes, а net 
which is symmetric with respect to the node тү. 


DT, 5, L-g Tg, Tq... y, oes 
We introduce a new variable t which serves to trans- 
fer the reference point to the point тү: 
‚ t = (£ — тау). (1) 
[n this case 1% = (2% —.ro)/h. 
We construct an interpolating polynomial in the follow- 


ing form: 
э 


Pane) o Ра(т UD): aol Epp 
Б Reon dy (0-19... (he "m 
| йг P (P— 1)... (P= (k— 179. (2) 


The unknown coefficients а, сап ре found from the condi- 
tions for coincidence of the polynomial Pan and the func- 
tion f al. the nodes z;. We note that relation (1) puts the 
quantity 4 — i into correspondence with cach of the 
nodes x;. For instance, t= is associated with the node т, 
and £ = — 3 with the node 7.4. 

Thus, to find tlie coefficients a;, we gel a system of 
linear equations 

Pa Gud HR) = hi E= 0, EN EA. (3) 
The structure of this system is such thal a, can be found 
direetly from the first equation of system (3): 
Pon (79) == а = fo 

and the search for the other coefficients reduces to the 


successive solution of systems of two cqualions in [wo 
unknowns: 


ЖЕГЕТІН! 
Pray (to h) +- fj a + A afa 
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Hence (see the designations in 7.7) a, = wf, а, = fs. 

Continuing this process, we note that at the jth step 
the determinant of the syslem of equations relative to the 
coefficients a5, , and аҙ; has the form 


1 1/2 
| 4 tig [= 1550. 


Consequently, all the coefficients a; of polynomial (2) are 
uniquely defined by the system of equations (3) and, by 
virtue of the theorem on uniqueness, expression (2) is an 
interpolaling polynomial for the function f. 

As a result of simple transformations we arrive at the 
following expressions for the coefficients: 


ao fy аца BIET ayy PEGA de A) 


Substituting the values of the coefficients obtained into 
expression (2), we gel Stirling’s inlerpolating polynomial 
which we designate as Sap: 

1 1 ,2, pfe 7t 
San (0) = fo = fot | Р fo E... (28 0r t(t— 1?) 


2h 
S (= (k= 1)?)-} us 12002 — 12)... (8 — (k— 19). (5) 


Since Stjrling's polynomial is only а new form of 
Lagrange’s interpolating polynomial constructed with 
the use of the nodes 2-р, . . ., Zh, it follows, by virtue of 
formula (4) from 7.5, that Ше remainder relative Lo Lhe 
variable ¢ can be represented ав 





h 
(2h+1) os . А 
па mpg TT CD RE л), (0) 


i=-h 


and the estimate of the error of the approximate value 
Pay (т) = Sox (1) (the error of the method) as 


A= | f (2) — 8(0] 


Mansi LAE 2012 12)... (12—89) |, (7) 


-ILOAYl 
“= Ok 1)! 


where Many max | f@)(z) 1. 
[xen Xp] 
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Let now the interpolation point т” lie between the no- 
des 7, and т, close to the point (г, + 1,)/2. We have to 
construct an interpolating polynomial of an odd degree. 
Then, as we pointed out above, the net, minimizing the 
error, is symmetric with respect to the point (7, + z,)/2, 
i.e. with respect to the point t = 1/2. 

Thus, on the net 


. 4% 4-һ, * эў 1—1, То, Ті, Таз en +} Tha eee 
relative to the variable t, defined by formula (1), we 
construct an interpolating polynomial in the form 

. b 1 
Parti (2) == Ран (To + th) = bo + Fp (-а) 


(Е)... сы t (12— 12) 
(à (k— 1)?) @—®) 


+ gear t(e— 8)... (8-8 09 (t=) @—®). (8) 





The unknown coefficients b; can be fonnd from the con- 
ditions of coincidence of the values of the polynomial 
P,,4,4, and the values of the function f at the nodes г). 

Thus, to find the coefficients b;, we have a system of 
linear equations 


Pop aa (To + th) = fi (i = К, ...,0, 13, ..., 
kaed. (9 


The structure of this system is such that its solution re 
duces to the successive solution of a system of two equa- 
tions in two unknowns: 


b 
Ponts (Zp) = -- — fo. 


b 
Pony (Ту) = byt > =f 


Hence by = pfies 5, = fip. 

Continuing this process, we note that at the jth step 
the determinant of the system of equations relative to 
the coefficients b,j- and b,,, is nonzero. It is easy to 
show this by analogy with what we did in constructing 
Stirling's polynomial. Consequently, all the coefficients 
b, of polynomial (8) are uniquely defined by the system of 


21—0104 


322 Computational Mathematics 


equations (9) and, by virtue of the theorem on uniqueness, 
polynomial (8) is interpolating for the function f. 

Simple transformations yield the following expressions 
for the coefficients: 


bs М baja Е (із1,2,...). (10) 


Substituting the values of the coefficients we have 
found into expression (8), we get Bessel’s interpolating poly- 
nomial which we designate as Barga: 





fi КӨШІП 
В, Mya +e (-з) 4- "m 1(1--1) 


yera (14) i 
M 


qub t0 T 1) (P— (— 0)0— 9 
HA vp oq 
+ бк 19) 
..(8-(-149(-09(:-2). (41) 


Since Bessel's polynomial is another form of representa- 
tion of Lagrange's interpolating polynomial constructed 
with the use of the nodes z-,, . . ., 2,44, it follows, accord 
ing to formula (4) from 7.5, that the remainder relative 
to the variable £ can be written as 

hl 


(2h+2) . 
В, = IA pne П (£— i), 


Ес (т_„, т) (12) 


and the estimate of the error of the approximale value 
Ран (2) = Bont, (£) (the error of the method) as 
А-1 


P Mons + ; 
A= | f (z)— Ba (4) iS S QE h” 2 П | i—i |, (13) 
i=- 
where М, = шах | f(z) |. 


The Thay 
We have.thus considered two interpolating polynomials: 


Stirling's polynomial which is used to construct a poly- 
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nomial of an even degree and is constructed with Ше use 
of an odd number of nodes and Bessel's polynoinial which 
is used Lo construct a polynomial of an odd degree and is 
constructed with the use of an even number of nodes. 

Now if the degree of a polynomial is not rigidly fixed, 
i.e. may be even as well as odd, then it is expedient to 
use Stirling's polynomial when 


[1% | = | z* —z, |/һ xz 0.25, (14 
D ) 


i.e. when the interpolation point 2% lies closer to the 
node zy than to the middle point between the nodes. 
Bessel's polynomial should be used when 


0.25 «z t* < 0.75, (15) 


i.c. when the interpolation point 2% lies closer to the mid- 
dle point between the nodes x, and z,. One of the condi- 
tions (14) und (15) can also be ensured by the choice of 
the appropriate node as тү. 


Example. Using ап appropriate interpolating polynomial, cal- 
culate, at the point zT = 48.63? and z$ = 49.19? the values of the 
function f -- sin z given as a table with a step of 1? (seo Table 7.9), 
which contains the value /; with four valid, in the narrow sense, 
digits. Estimate the error of the result. 

A We have established in Example 2 in 7.7 that the order of 
correctness of the table is 2. It is not advisable, therefore, to con- 
struct an interpolating polynomial of a degree higher than the 
second, i.e. it is expedient to construct either Stirling's polynomial 
of the second degree or Bessel’s polynomial of the hrst degree. 

Since the point 27 = 48.03 lies closer to the middle рәт be- 
tween the nodes of 48? and 49°, we must take the node of 4#“ as т, 
when calculating sin 1%, and make use of Bessel's polynomial. 
Then :* = (c* — z) h> = 0.63. Тһе point тї == 49.19? lies 
close Lo the nodo of 49" and, therefore, we must take the nodal 
point хо == 49° as the central node when calculating sin z$ and make 
use of Stirling's polynomial. Then ¢§ == (r$ — ту) h-? = 0.19. 

Thus, employing our previous statements, from formulas (11) 
and (5) and also from the data given in Table 7.9, we have 


4 SOE 043 — 0.150408, 





8, (0.49) = 0.7547 + ET 


0.19 


--0 ) 
RIAM. -0.192 = 0, 7568809. 
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We shall estimate now the errors of the method using formu- 
las (13) and (7) respectively: 


A (By) & A “a (m) -0,63-0,97 —0.27-10-4, 


М 2 = 
M (5) x (5) 0,10 [0.192 —12| -а0,2.40-4, 


Taking into account the errors of the values of the function and 
of its finite differences given in Table 7.9, we get the values of the 
computational errors: 

A, (B4) = 0.5.10-4 + 1.10-*.0.13 = 0.63.10-*, 
Ag (Sg) = 0.5-10-4 + 1.10-4.0,19 + 1.10-%.0,19% 
= 0,73-10-4, 

When rounding off the values B, (0.63) and S, (0.19) to four deci 
mal digits, we get the following rounding errors: A, (Bj) = 
0.08.10-4 and Д, (S,) = 0.11.10-4, 

Combining all the errors we have found, we obtain sin 48.63° = 
0.7509 + 0.0001, sin 49.19? = 0.7569 + 0.0001. A 


Remark. In some cases, to minimize the total error, it 
is expedient to use an interpolating polynomial whose 
degree is higher than the order of correctness of the 
table of finite differences. This can be explained as 
follows. Naturally, the computing error increases with 
an increase in the degree of a polynomial. At the same 
time, the decrease in the error of the method can be so 
sharp that it involves a decrease in the total error. 


7.9. Newton's First and Second Interpolating 
Polynomials 


If the interpolation point z* is at the beginning or the 
end of the table, then it is not always possible to choose 
a sufficient number of nodes to the left and to the right 
of z* to construct the necessary finite differences. In that 
case we use special forms of an interpolating polynomial. 

Let the Point 2% lie close to the first node of the net 
2 Ty, .. . . We consider a variable ¢ defined by 
relation (0) from 1. 8 and construct an interpolating poly- 
nomial in the following form: 


P, (х) Р, (ә + th) 
-a +t t+ 3 t(t—1)+...4+4% P t...(t—k+1). 
| (1) 
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We find the unknown coefficients а; from the conditions 
of coincidence of the polynomial P, and the function f at 
the nodes z,. Recall that each node т, is associated with 
the quantity ¢ = i. Thus, to find the coefficients a,, we 
get a system of linear equations 


Р, (х, + ih) =f, (i =0, 1,..., 8). (2) 


The structure of this system is such that а, can be found 
directly from the first equation of system (2), a, can be 
found from the second equation for a, already found aud 
so on. Indeed, setting i = 0, we lind, from the first equa- 
tion of system (2), that 


P, (т) = 4, = Tos 


from the second equation we find, for é = 1, that 
Piroth) = = T= fy, a = АЈ. 


Continuing this process, we e get, as a result of simple 
transformations, the following expressions for the coeffi- 
cients: 

ay = fo a; = Nf (і-1,2,..., №). (3) 

Substituting the values of the coefficients we have found 
into relation (1), we get Newton’s first interpolating 
polynomial which we designate as М: 


NEG) = fot aie t+ Sh e(t—1) + 
ЖЕЛГЕН (t—k+4). (4) 


By virtue of formula (4) from 7.5, we can represent tle 
remainder relative to the variable ¢ in the form 


(А+1) 
Ry- ЕРЕ MEL) ss (0—0), EEG д) (5) 
and tlie estimate of the error of the approximation Ni (t) 
(Ше error of the method) in Ше form 


Ао И) NAD |< MP LT 1). (EY, 


(6) 














where M,,,— max | f+!) (х) |. 
(xe. ху] 


326 Computational Mathematics 


Let now the point z* lie close to the last node of the 
net ... Z-n, ..., 2-0, Tọ Again using the variable t, 
defined by relation (1) from 7.8, we construct an interpo- 
lating: polynomial for this net in the form 


D, (х) = P, (1, + th) 
=a+ AU 3 і(і--1)--.. + . (t4-k— 1). 
(7) 


The unknown coefficients а; can be found from the con- 
ditions of coincidence of the polynomial Pj; and the func- 
tion f at the nodes z;. Note that the node z-, is asso- 


ciated with the value ¢ = — i. Thus we get a syslem of 
linear equations 
P, (т, — ih) = fi (i = 0, 1, 4" k) (8) 


to obtain the coefficients a;. The structure of this system 
is such that a, can be found directly from the first equa- 
tion of system (8), a, from the second equation for a, 
already found and so on. Indeed, setting i = 0, we find 
from the first equation of system (8) that 


Р, (т) == а, — fo 


and from.the second equation, for i — 1, we liave 
Py (rg — №) = = fot qp 1 fas а ты Vf. 


Continuing this process, we get, as a result of simple 
transformations, the following expressions for the coeffi- 
cients: 


Oy = for ai= Vif, (i= 1, 2, ..., k). (9) 


Substituting the values of the coefficients we have found 
into relation (7), we get Newton's second interpolating 


polynomia? which we designate as N}! 
T(t) = fo-- Me e+ S o 1) + 
.. КУ D. „@+Е—1) (00) 
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with the remainder 


(h+1) 
R, E h/*1 (3-1) ... (£4- k), (11) 


EE (tps ту), 
and the estimate of the approximation error 


M 
A= MG) NT Q) Ege Р" eet A) Hk), 
(12) 
where Mj,4,,— max | f(z) |. 
х Xo} 

Formulas (4) and (10) are often called Newton's inter- 
polation formulas for the forward and backward interpola- 
tion respectively. 

Exampie. Set up appropriate interpolating polynomials and 
calculate, ә! the points тї = 0.63 and cf = 1.35, the values of the 
function у — 3' given as a table which contains the values f; with 
four valid, in the broad sense, digits: 


z| 0.50 | 0.75 | 1.00 | 1.25 | £5 
f | 1.732 | 2.280 | 3.00) | 3.948 | 5.196 


Evaluate the error of tho result. 

A We put in this table the values of finite differences writing 
the values of the errors of the corresponding finite differences in the 
last row: 





Table 7.10 
x | ! | hn | pP | һ | fs 
0.50 1.732 
548 
0.75 23.280 172 
720 56 
1.00 3.000 228 16 
948 72 
1.25 3.948 Зоо 
1248 
1.50 5.196 
| 0.00] | 2 | 4 | 8 | 16 
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Since the fourth finite difference coincides with its error, it is 
not expedient from the point of view of the calculation error, to 
approximate the given function by a polynomial of a degree higher 
than the third. 

Furthermore, since z? = 0.63 is at the beginning of the table 
und z$ — 1.35 is at its end, it follows that we must use Newton's 
first interpolating polynomial to calculate f$ = 3943 and Newton's 
second interpolating polynomial to calculate /% = 3! 35, 

Thus, setting г; = 0.5, we calculate 1% = (z$ — zh = 
(0.68—0.5)/0.25 = 0.52. Substituting the value of t? obtained into 
expression 4) for Newton's first interpolating polynomial and using 
the values of finite differences given in Table 7.10, we obtain 


Lo sna Tao 1 9:548 у 0472 ey 
NJ (0.52) = 1.732 + —7—-0.52-- = -0.52.(— 0,48) 


" 2.050 *0,52 ( — 0,48) ( — 1.48) = 1.9989420, 





Similarly, setting 20-- 1.50, we calculate /% — (1.35— 








1.50)/0.25 — — 0.60 and, using expression (10) for Newton's 

second interpolating polynomial, we obtain 

МИ (0.60) = 5.196 + 28 -(—0,69)-- "аи + (-—0,60) 0.49 
0,072 


—3 '"(—-9.90 *0.40« 1,40 = 4.407168. 


Let us use formulas (6) and (12) to estimate the error of the 
method: 





A, (М1) < 2 nt 3 0.258.0,52.0,48.1.48.2,48 = 0,0009, 
4 
A, (NE) < D2 iS 0,25 .0,80-0,40-4.40-2,40 2 0,001. 


Taking into account the values of the errors f given іп Ta- 
ble 7.10, we evaluate the computational errors: 


А, (NI) < 0.001 + 0.0011 + 0.0005 + 0.0005 == 0.0031, 
А, (NET) < 0.001 + 0.0012 + 0.0005 + 0.0005 = 0.0032. 


Rounding off the values МІ (0.52) and Nj! (— 0.60) to four decimal 
digits, we get the following rounding errors: 
Аз (М1) =0,06.10-3, Д, (NIT) «0.2.1075, 


Combining all the errors found, we finally have 39.93 =: 1.099 + 
0.005, 31.9 = 4.407 + 0.005. A 
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7.10. Divided Differences 


In the preceding sections we considered various forms of 
interpolating polynomial for a uniform net of nodes. The 
coefficients of the polynomials constructed were found 
with the aid of finite differences. In this section we again 
consider the case when the values of a function are given 
at nonequispaced nodes. In such a case, instead of finite 
differences we consider divided differences which are, in 
a sense, an analogue of the concept of a derivative and 
are defined as follows. 

Assume that the function y = f (z) is defined by its 
values yy = Ї = Í (£o) у = һ = ] (г), 2.9 Уа == [= 
f(x), ... at the nodes z; of an arbitrary net A,. The 
divided differences of order zero f (г) coincide with the 
values of the function at the points шу. Relations of the 
form 





Қазды ^, flen r) = 2, 
EINE f ie 


are known as the first divided differences. Relations of the 
form 


Í (zo, тү, 22) = П 2)— o гу) 


I3— Ig 
f (Ei a xy) Ee En а , 


ODD Қ | ЖЫТ КК 
f (zi, Zito Live) = Fora Shoal Fur es 
are the second divided differences. In the general case, the 
kth divided difference can be found with the use of the 
(k —1)th divided difference from the formula 


Í (Zis Litas «s inn) 
Гань, HAE] Tish) — Í (zi, ...) Ti+h-1) (1) 
Tieh — Ti ‘ 
Other designations can be used for divided differences 
(dillerence quotients): 


fo Ты." Li+h) = lzi, Litas s+ oy Zi «Al. 
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[t is convenient to tabulate divided differences by 
analogy with what was done for central finite differences: 


Table 7.11 


























zi (Га) | [fi zal [Zi Tie | {гә Zon | [zb Tien 
Tira] Visa, Ті Lisa, Tip 
гі 
e| ^ | | | | 
| | tzo nil | | | 
тү | y | | zo, <1, za) | | 
гі, 231 Іт. Ті, | 
тә, т, | 
T3 Y2 [ri 29, 23] (Ty, гур, 
Pa, Tg, £4 
И ғу, тз] ігі, T2, 
T3, T4 
al» | dem | 
| | [Z3, 741 | | | 
a| n| | | | 





Example 1. Compile a table of divided differences for the func- 
tion y — f (z) given as the following table: 


г | n | 1| $ | 10 


A Using the definition, we find the first divided differences 
и— уо 2) —10 


(о, 11| = 21—210 =-110 == 40, 
..Ja—yi  100—20 80 — 
[n Ше, 2 -- 5-1 704 09 
— --4( 
[гь г] = 380 — им — 1000 у 


23-1; 10--5 5 
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In a similar way we find the second divided differences: 
ігі, z;]— [ro zi] _ 20—10 


[zo 21, 23] = таң “ву 77 
[in 2s] —[21, s] 29-20 , 
ігі, 2%, tea, р 20 


The third divided dilference 


[=1, To, 23] — [£o, 21, 1. 20-2 





(2, Ті, T, тз] = тұ--т; = - 10 —1.8. 
We tabulate the results of calculations: 
x у ік 214] | [xis Xj us qual Со Xip Fisa Firal 











Here are some properties of divided differences. 
1°. Divided differences of all orders are linear combina- 
tions of the values f, = f (ғ), namely, the following formula 


A 
holds true: Қа» ә 23) — dy 10 
i=0 [| (i —2) 


j—0 
ізгі 


O For k—O we get an identity /(т;))--/р for А-1 


we have /f (Zo, z) =E, And this is the defini- 


1 
Lion of the divided difference f (zo, 2). 
We shall continue with the proof by induction. Assume 
thal equality (2) is valid for all k< n. Then 


А f (To ++) zn) — f (zi, ..., па) 
Кто oe) ган) = tana 
п+і 


п 
1 / 1 
T To Tm 2; aot – Х ж 
i=0 || (2) i 11 (т; —т)) 
j-=0 I= 


j= 
ізі js 


. (2) 
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Sap + Ў "ub o + n Inn 
T. (20—23) i=l T. (zi— zj) II (Zn«1— 2j) 
ігі 3-0 

554 
п+1 у 

= 2, n1 : 

i=0 || (2) 
2-0 
ізі 


Thus equality (2) holds true for k = n -+ 1 as well. Bi 

2°. A divided difference is а symmetric function of its 
arguments, i.e. it does not change upon their permutation. 

О Ороп any permutation of the arguments zy, . . ., ту, 
Ше corresponding terms on the right-hand side of relation 
(2) only change places but the sum evidently remains un- 
changed. Consequently, the left-hand side of relation (2) 
does not change either, i.e. f (zy, . . ., z,). B 

З”. A divided difference satisfies the equality 


(af + bg) (ғ... m) = af (х, ... тк) 
+ bf (,..., 2), (3) 

where a and b are constants. 

This immediately follows from relation (2) since its 
right-hand side is linear with respect to /;. 

The next property expresses the connection between the 
divided difference f (ry, . . ., тд) and the derivative /"(z). 

4". If the nodes zy, . . . , zy belong to the interval (а, b] 
and the function f (x) has a continuous kth-order derivative 
оп (а, b], then there is a point E Є (a, b) such that 


1 
Í (Eor «e Ж) = Rp AP). (4) 
This property уез а simple corollary. Let f(z) = ао" + 
аа с! р... + а, be a polynomial of degree k. Then, 


evidently, fo (т) = ak! and relation (4) yields the fol- 
lowing value for the divided difference: 


Í (os <- -> а) = qp ok! = a. (5) 


Thus for any polynomial of бөге k the kth-order divid- 
ed differences are equal to a constant quantity, which is 
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the coefficient in the leading power of the polynomial. 
Divided differences of higher orders (higher than X) are 
evidently zero. 


Example 2. Let us verify the validity of Property 1? using 
four values of the function y = f (2), i.e. у, — f (т) (i = 0, 1, 2, 3). 
We find the first divided differences: 








ға ту ТЫНЫ, ау a= ШІН, Gg ә) - ЕЕЕ, 
and then seek the second divided differences: | 
_ Jo — V1 Ші H9 ) 
ту, Tj, Z3) = —— ————— 
Í (Tos та) Za) Zo— Ta \ To— 74 Ti— T4 
__ Уо 
(To — 71) (7o — 73) 
. У1 Из 
+ (zy — zo) (71 — T3) + (Ta To) (0, —ту) * 
1 (Ail Ji) 
f Gri, Tay Ta) = Ti— Ty ( Ti--Tg 7-4 
— l. 
(Z1 — 23) (01 — 23) 
Уз Ja 
T (£e — 01) (Ta — 24) + (rc Ta) (304) 7 


This is in full accord with Property 1?. We can show in a similar 
way that the third divided difference 


un 

Gr Го) Gà — Fa) (Ti -ту) 
Yo 

(74— To) (т; — 21) (7, — г) 
fa 


(ға--14) (1--11) (3 73) * 
We calculate the third finite difference using the values of the 
function nnd the argument given in Example 1: 


40 2n 

[To 21, 22, t= (= (ety 104): 
100 1100 1,5 22 

T 5-4-(—5) tinge Ta tacit Ге 


This coincides with the value obtained in Example 1. 

Example 3. Let us verify now the validity of Property 2" for 
the function y = f (т). We shall show, for instance, that / (zo, ту, 
гу) = f (тү, Zor ту). 
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h Indeed, according to tho definition of a divided difference we 
ave 
2 4 V1—WVo  Yo—Ya 
Í (ni, Tos 2) = 21-1; ( 1,1, Ip —Zq ) 


__ 1 Уо 
^ (гі-4) (Z1 — Fa) + (zo — 71) (1o — Ta) 


Yo 
MEC IET NE 
We have obtained the same result as in Example 2 (with a change 
in the sequence of terms). 

Example 4. We shall illustrate Property 3°. Together with the 
function y = ) (г) given in Example 2 we shall consider a function 
z = g (г) and its values z; = g (zj) (t = 0, 1, 2, 3) specified at the 
same nodes as y;. We set up a linear combination u (г) = af (т) -|- 
bg (z), where a and b are constants. Let us now calculate 
и (20, ту, 23). As in Example 2 we find that 


~ Seb 0c ayı t bay 
и (Tor т, 23) = (To — 21) (19 — 23) (11—20) (71 — T2) 
+ ay, -F bz, 


(T2 — z0) (z2— 21) * 
Grouping separately tho first and the second summands of cach of 
the three terms of the sum, we obtain 
и (20, 21, т) = af (ry, ту, T2) F bg (Zo тү, £3), 
and this is what wo wished to prove. 


7.11. Newton's Interpolating Polynomial 
for an Arbitrary Net of Nodes 


Using Lagrange's form, we represent the interpolating 
polynomial as 


Lo (т) 1 (Ly (ж) — Lo (2) 4... + (Enr (ш) — Lua (0). 


Шеге Lo (г) = f (20), Ly (т) (k = 1, 2, ..., п) are inter- 
polating polynomials in Lagrange's form constructed 
with the use of the nodes 70, z,, . . ., 7,. We consider the 
differences 

h-1 


k 
L,—Ly4— У) hue ay Sr za (г) 
і-0 i=0 


z) o (т) | zi) ө,. 1 (zi) 





h-1 h 
_* G1 (2) Wp-1 (2) _ ti 
7 2 f aie) t oG On) 2 (е): 
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Thus, using formula (2) from 7.10, we obtain 
Lr — Lra = On- (2) f (т, -> Tn) (t) 
and the interpolating polynomial assumes the form 


Ny (т) = fo -t (£ — To) f (24. 2) +... + (£ — T0) 
‚.. (£ — 1,41) f (Tos -© Zn). (2) 


This form is known as Newton's inlerpolating polynomial 
with divided differences. 

Тһе ex pression for the error has evidently the same form 
as in the case of Lagrange's polynomial [see formulas (8) 
and (9) from 7.5] 


Example 1. Using tho nodes т, == 0, zı = 1/3, х, — 1, construct 
Newton's interpolating polynomial for the function f ~- sin (17/2). 

^ Taking into account that fy = 0, f, = 0.5, fg — 1, we set 
up Lhe necessary divided differences: 








1 1 

073 3 Y75 3 

1 (70, 21) = 4 2 Ма, oT 1 =F 
0--- ---- 
) 3 4 4 
3 3 
2 4 3 

Ho ty = mp зр. 


Substituting the values obtained into formula (2), we have, for 
n — 2, the following polynomial: 


N, (9—04- 3- (2—0) - (х — 0) (3) . 


This polynomial must evidently be identical to Lagrange's polyno- 
mial constructed in Examplo 1 in 7.6, The reader is invited to 
prove this independently. A 


Note that in form (2) of interpolating polynomial a unique 
condition is imposed on the nodes z;, their noncoin- 
cidence. Therefore, the nodes may be enumerated arbitra- 
rily. For instance, the index "O" often denotes the last 
node in the table, z,, its last but one node and so on. 
In this case polynomia! (2) assumes the form 


М» (т) — fo + (z —29)f (zo, т-у) 
+...+@—ж)...(хж—хт_һ+)/(т, ..., Z-n) (3) 
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and is called Newton's polynomial for backward | inerpola- 
tion. 


To illustrate what we have stated, we shall solve Example 1 for 
ту = 1, г.у = 1/3, z. = 0. From formula (3) we obtain 


Ny(2)=14- (@—1)—4 6-0 (2-4). 


Note that the necessary divided differences have been taken 
from Example 1, the property of their symmetry being used with 
respect to their arguments. 


The comparison of Lagrange's and Newton’s forms for 
an interpolating polynomial makes it possible to recom- 
mend the use of representation in Lagrange's form, first, 
in theoretical research, say, to study the problem of 
convergence of P, (f, т) to f as n — oo, second, to inter- 
polate several functions on the same net of nodal points 
since in this case Lagrange's multipliers l; can be calculat- 
ed once and then used to interpolate all the functions. 

Representation in Newton's form proves to be the most 
convenient in practical computations. Indeed, the num- 
ber of nodal points to be used and the degree of the 
interpolating polynomial are often not predetermined and 
when we pass from n nodes to n 4- 1 nodes in Newton's 
form we add only one term which has the sense of a cor- 
rection of the value already calculated, whereas іп 
Lagrange's form an addition of one more term must be 
followed by a complete recalculation of the result ob- 
tained. In addition, in computations interpolation is usual- 
ly carried out on a small interval of length h < 1 and the 
summands in Newton's form аге of the order of h?, h!, 
h’, . . ., i.e. are arranged in a decreasing order, which 
is convenient when the accuracy of the result of inter- 
polation is determined. 


7.12. Practical Interpolation in Tables 


Linear or quadratic interpolation is usually used when 
interpolation is carried out in tables. 

In the case of linear interpolation the value of a func- 
tion at a point different from the interpolation nodes is 
found from two known values of the tabulated function 
и = Í (21), Yeti = f (2143) at the interpolation nodes т, 
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and т;;, between which the value of the required argu- 
ment z lies. 

Lagrange’s interpolation formula for linear interpola- 
tion assumes the form 
— 1 


v "EST 


—2{ 


ы 


L, (ж) = Ji 


and Newton's first interpolation formula assumes the form 
N, (т) = y, + Ht <4 (z — zi), 


where Ay; = у — y; is the first finite difference at the 
point т; and А — 2;4, — z; is the stepsize of interpola- 
tion. 

Thus, to use Newton’s formula to obtain an approxi- 
mate value of the function y (z), it is sufficient to add a cor- 
rection equal to Ay; (т — z;) h- to the tabulated value y;. 

Example 1. Find out how many degroes are there in the radian 
measure 0.22? . 

^. We use the table 


Radians Degrees 
0.22 12.615 
23 13.178 

24 13.751 


To carry out a linear interpolation, it is sufficient to consider the 
data in the йге two rows, We set up a tabular difference 


Ayi == ура — yi = 18.178 -- 12.605 = 0.573. 


The stepsize of the table л -= 0.01, r — z; = 0.222 — 0.220 = 
0.002. We calculate the correction 


Ay 0,573 ; 
ТЕ («--)- XT 0,002. -- 0,1146 








aud add it to the tabular value: 
у = 12.605 + 0.4146 - 12.7196. 


us verify the error of the value obtained. Using formula (8) 
5, we have the following value for the error of the method: 


M, 
21 


Let 
from 7. 


А, = 





2 — 0,22) (4,222--1,23)|. 


22—0104 
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Since the function being interpolated is y — (180 г/л), it fol- 
lows that М, = 0 and A, = 0. 

Let us find the computing error, taking into account that the 
error of the initia] data constitutes 0.0005: 





Aa 0.0005 + m . 0,002 = 0.0007. 
ea: off the value y (0.222) to three decimal digits, we get 


= 0.0004. 

* Summing up all the errors found, we finally have у(0.222) = 
12.720 + 0.0011. А 

In the case of a quadratic interpolation we use three 
values of the tabulated function yı = f (z_,), Yo = 
Ї (ш), y; =f (ті). The interpolating polynomial is 
constructed either in the form of Lagrange (for nonequi- 
spaced nodes) or іп Newton's form when the interpolation 
point is closer to z, or to z, than to Zp, or in Stirling's 
form when the interpolation point is close to the node To. 


Example 2. Construct Newton's interpolating polynomial for the 
function y = In z using its tabulated values 
т | 2 | 3 | 5 
y | 0.6931 | 1.0986 | 4.6004 


and obtain a uniform estimate of the error on tho interval [2, 5]. 
A First of all we seek divided differences: 


1.0986 — 0.6931 
3—2 
1.6094 — 1.0986 
5—3 
0.2554 —0. 4055 __ 
5—2 


Substituting the values obtained into formula (2) from 7.11, 
we find, for n — 2, that 


М, (z) = 0.6931 ++ 0.4055 (г — 2) — 0.0500 (z — 2) (z — 3). 
Using estimate (8) from 7.5, we havefor the orror of the method 


А, = Мз max |(z— 2) (z —3) (х — 5) |. 
12, 5] 


10, 3) = 0.4055, 


f (3, 5) == —(0.2554, 


f(2, 3, 5) = —0,0500, 





3! 
Next we find that 


M,= max- 2 
(2, 5] 


Thus A, = 0.1. 


1 
4 , 





max |(z—2) (z—3) (z —5)| = 2.2. 
[2, 5] 
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The computing error is evidently negligibly small as compared 
to the error of the method. Therefore the maximum possible error 
of interpolation is 0.1. A 


7.13. Aitken's Iterated Interpolation 


It is expedient to employ Aitken’s iterated interpolation when it 
is not necessary to obtain an approximate analytic expression for 
the function f (z), given in a tabular form, but the only problem is 
to find the value of this function at a point z* different from the 
interpolation nodes. The gist of the method is a successive linear 
interpolation. The process of computing f (z*) is the following. We 
enumerate all the interpolation nodes, say, in the order of their 
receding from z* and compile the following table. 


Table 7.12 
т, Pi pi^ Ро24 py 
т; P? pt? py pos 
т P} pi^ pos 
т, P} pj? 
T3 Р 
Неге 
Рё = f (ть), 
i r—1] r— Zi 1 т—т; Рі 
Pi? (2) = fi ———— ——À— = 40% 
P haath Fay aa 22, P 








is an interpolating polynomial of a degree not higher than the 
first, constructed with the use of the nodal points г, and гу, 
1 r— 7, pi 


Рі)" (2) = ———— 
> Zh— z; | z—2, Р} 








is ап interpolating polynomial of a degree not higher than the second 
constructed with the use of the nodal points г), гу, zx. Continuing 


22* 
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this process, we construct a polynomial 
т—а Pii # (т) 


T—Tm pi: i кт (т) 


1 


pti. -hm z)— 
gem а 


a) 





We shall show that if Рі: А (т) and P$; (г) are interpolat- 
ing polynomials constructed with the use of the nodal points r,, 
Tj, +++) th ANd г),..., Zh, Zm respectively, then pi...km (г) is 
an interpolating polynomial constructed with the use of the nodal 
points Zi, 2), ..., Thy Em 

Indeed, first, P^" (z) is a polynomial of a degree not higher 
than n. This сап be seen from the construction of formula (1). 
Second, at all nodal points т, the polynomial Р;/ «Ат (ту as- 
sumes the corresponding value: 


— (ri — tm) li -ji (rp 


ріј- ..Ат (у 
п ( i) Tg — Ti 


—т), 
Pii (em) “тт — іы (2) ag, 
t 


pi. hm (rp) ==, (pri) Íp—(tp— Tm) fp) = ір. 
. Тт-- fi 

Calculating successively the values P? Їз?! (z*) from formula 
(1), we take them Lo be the successive approximations of f (z*). The 
computing process is terminated when the absolute value of the 
difference of two successive approximalions becomes sufliciently 
small. . 
Example 1. At the point 2% — 6 calculate, with an accuracy of 
е == 0.05, the value of the function / = ln z given as a table 


| а |2 | 4 | 5 | 8,1 m" 
f | 0.00 | 0.69 | 1.39 | 1.61 | 2.08 | 2.9) 


A We enumerate the nodes as follows: т, = 5, zi = 8, Ta - 4, 
та = 10,2, = 2,2, = 1. Using formula (1), we calculate the values 
of the interpolating polynomials Р, (б): 


4 6—5 1.61 


o1— 1_, —1.77 
Pi'—3—s'|e—8208| 17^ 
1 6 —4 1.39 
ов, — 4.8 
Ра ваи | 1:89. 
1 6—4 1.83 
012-- . -- 1) 
P} 8—4 `| 6—8 vn | 18". 


Since |P0? — Ро 12 | = 0.03 < 0.05, we terminate the calculations 
and set ln 6 = 1.80 + 0.03. 4 
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Example 2. Using Aitken's scheme, calculate, with an accuracy 
of 0.5-10-4, the value of sin 0.674 lor the function y = sin т, 
given as a table 


10 0.66 | x, ==.67 | Іа = 0.68 
yo = 0.61312 | y — 0.62099 | уз = (1.62879 


A According to formula (1) we have 
| 0.674 — 0.68 0.61312 
0.674 — 0.67 0.62090 


D01 (() 6 ті 
P91 (0.674) 0.67 —0.66 


= 0.625739, 





1 0,674 —0.67 0.62099 
12 M в , — X 34 
Pr = 68-67 | oieta Lua 0.625643 | 8256143, 
122. 10.674—0.66 0.625730 | 
ТО НИ ов . 
РР? = 1168—1766 | 0.674 —0.68 0.625643 | ^ 925676. 


Consequently, sin 0.674 — 0.62568 -+ 0.00004. A 


7.14. "Opti;ral-Interval" Interpolation 


Let us consider again the estimate of the error ex pressed 
by formula (8) from 7.5. We assume now that there are 
no restricLions in Lhe choice of the net А,. We pose a prob- 
lem of Lhe best choice of interpolation nodes. Proceeding 
from the estimate (8) from 7.5, we find that the best 
interpolation nodes for the class of functions С" (la, b]) 
being considered are г; for which the expression 
max |o, (2) | is minimum. The determination of 


[а,Ь] | 
these nodes actually reduces to finding the roots оға poly- 


nomial which has the smallest deviation from zero en the 
interval (а, b]. As is known from the theory of functions, 
such a polynomial is generated by Chebyshev's polyno- 
mials of the first kind which are defined by the following 
recurrence formulas: 
Ty = 1,7, =a, Tagi = 227, — Try n> 0. (1) 
Let us consider the principal properties of Chobyshev's poly- 
nomials. 
19. The leading term of the polynomial T, +, results from the 
leading term of the polynomial T, (n — 1, 2, . . .) multiplied by 2r. 
O We have 
T, — 22-2 — 1 — 222 — 1, 
Ta = 2z (2r! — 1) — z = 425 — 3z. 
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Therefore the leading term of the polynomial 7,,,, is equal to 
292851, Tho general form of the polynomial Т„+ is 


Tny = 2"2™14- i 


2°. All the polynomials T,, (т) are even functions and Tan (т) 
are odd functions. 

О For п = 0 this is obvious. Let this be valid for a certain n. 
Then the function 2z7,,,, (т) is even and, hence, 7,,,, = 
2zTan+1 (г) — Tan (т) is also an even function. Furthermore, the 
function 2z7,5,, (z) is odd and therefore 75,45 (т) = 227 anea (2)- 
Pansy (г) is also an odd function. Ш 

3°. Jf z € [— 1, 1], then Chebyshev's polynomials have the fol- 
lowing vzplicit expression: 


Т, (2) = соз [(n + 1) arccos z], n> — 1. (2) 
C We shall prove that the right-hand side of relation (2) satis- 
fies definition (1) of Chebyshev's polynomials. Indeed, 
(cos [(п +1) arccos z]}, ——1 =1 = To, 
(cos [(п +4) arccos z)}n=0 = 2 — 7. 
To prove that the recurrence formula holds true, wo consider 
the obvious trigonometric relation 
cos (n + 1) 8 = 2 соз 0 cos пд — cos (n — 1) 0. 
Setting 0 = arccos z, whence it follows that z = cos 0), we get 
cos [(n + 1) arccos т] = 2z cos [n arccos =] — cos [(n — 1) arc- 
cos z]. Ш 
4°. On the interval | — 1, 1] the polynomials Т. (т) have n +- 1 
distinct roots: 
2k+1 
2(n4-1) 
О Using expression (2), we get the following equation for deter- 
mining the roots of the polynomial T, +, (т): 


тһ = COS л (k—0, 4, ..., n). (3) 


(n --1) arccos zy = - + n (Е--0, 4, ..., n). 


Solving this equation for тд, we arrive at relation (3). M 
59, On the interval [— 1, 1] the inequality 


ІТ, (2) |51 
holds true. 

This follows immediately from relation (2). 

From the same relation (2) we find all points zm at which the 
polynomial 7,,, (г) attains its extremal values + 1. For this to 
occur, it is necessary that 

(n + 1) arccos z,, = лт (m= 0,1, ..., 2+ 1) 
and, consequeatly, 


л (m=0, 4, ..., n-- 1). (5) 


Zm = cus 





m 
n+1 
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Substituting these values into relation (2), wo obtain 
Тн (Zm) — cos тл = (--1)™. (8) 


This means that the points, at which 7,,, = 1 and 7,,, = — 1, 
alternate beginning with zg = 1, where 7,,, (1) — 1. Note once 
again that inoquality (4) holds true not for all z. If | < | > 1, thon 
arccos z does not exist on the set of real numbers. 


Let us consider now polynomials 
Tia (rZ TQGemrUx... (7) 


These are polynomials which have the smallest deviation 
from zero оп the interval (—1, 1]. This fact is substanti- 
ated by the following theorem. 

Theorem. Let Р, ү (т) be a polynomial of degree n + 1 
with the leading coefficient equal to 1. Then 


max | Pps (2) |> тах |T,4(2] 27. (8) 
1] 1] 


C] We assume that inequality (8) does not hold true. Then the 


polynomial Ол (2) = 7,,, — Pps, whoso degree is not higher 
Шап n at all n + 2extremal points z,, of the polynomial Tası 
would coincide with the latter polynomial in sign and, consequently, 
would alternately assume positive and negative values at these 
points. Therefore Q, (г) must have n + 1 distinct roots, and this 
is impossible for a polynomial of a degreo not higher than n. The 
contradiction obtained proves tho theorem. Ni 

Every interval |а, b] can bo obtained from the interval [—1, 1] 
by means of a linear change of variables 


"= 0+6 S z. (9) 





In this case the polynomial 7л, (т) is transformed into a poly- 
ет 2x —(b-|-a) . | : 2 ұлы 
nomial 7,,, (576) with a leading coefficient (а . 


Consequently, 


- 2r — (6 4-а 

Tie, b (т) = (6 — а)"*1 2-27-17, | ( шешесіз) (19) 
із a polynomial with a leading coefficiont 1 which has tho smallest 
deviation from zoro on the interval (а, b], and the following in- 
equality holds true for any polynomial Р. (т) of degree n + 1 
with a loading coefficient 1: 





b—a y" 


max |Р > max [718 b] on Í (11) 
la, х | na (z)) > te. A nti (2) V 2 
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By virtue of the linear change of variables (9), the roots of the 
polynomial 71:01 (z) have the form 


zc ыға + = сов See (k—0, ..., п), (42) 








aud the extremal points have the form 


tm= ote DI cos zu л (m—0,1, ..., п+1). (43) 








We shall return now to the problem of the minimization 
of the error of interpolation A, on the interval (а, b] for 
an arbitrary net on the class of n + 1 times continuously 
differentiable functions which satisfy condition (7) 
from 7.5. We shall designate this class of functions as 
С" (Mn+: [a, b]). By virtue of formula (8) from 7.5, to 
solve this problem we must minimize the quantity 
max | в, (г) |. Since о, (х) is а polynomial of 
a, 
degree n -+ 1 with a leading coefficient 1, it is evident 
that the quantity max |, (т) | attains its mini- 


a, 
mum value for Chebyshev’s polynomials Tiet (x). 
Consequently, we must take as the interpolation nodes 
the points z, defined by expression (12). In this case 


max | o, (2) | = шах (Ға) L2 (22) ‚ (14) 
[a, b] [a, 5] 
and estimate (8) from 7.5 assumes the form 
Ма o-n [ba "+! с 
мүрү?" (ж). (19) 


This estimate cannot be improved since we shall have 
an equality sign in it if we choose the polynomial of de- 
gree n 4- 1 


Mn+ h+ n 
f(z)= E дераза"... 


as the function f (г) and the points г, defined by expres- 
sion (12) as interpolation nodes. 





Example 1. On the interval [— 1, 1] obtain a uniform estimate of 
the deviation «б the function / (г) = 1 — cos (12/2) from its inter- 
polating polynomial constructed with the use of Chebyshev's nodes 
(3) for n — 2, 3, 4. 
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A Note first of all that for the function in question on the 
given interval we have М, = (n/2)^*!, b — a = 2. Therefore, by 


virtue of estimate (15), we havo 


3 3 
n2, м< (5) 3 (+) e 0,17, 


2 3 
. лү 1 1 ұз . 
n—3, Aix (+) г (=) e 11.032, 
лү» 1 1 үх 
п:= 4, Ау (+) "er (>) = 0,005, 


We recommend the reader to compare the solution oblained with 
the solution of Example 1 from 7.5.4 


7.15. Interpolation with Multiple Nodes 


Up till now we considered a problem in which the inter- 
polation pay. "тоогу, i.e. the coefficients of the interpolat- 
ing polynomial, were defined only by the values of the 
interpolated function. This problem is often called an 
interpolation problem in the sense of Lagrange and the pro- 
cess of constructing the interpolating polynomial, Lagran- 
ge's process. 

We shall consider now а more extensive problem, that 
of interpolation with respect to Ше values of a function 
and its derivatives or, as they also say, the problem of 
multiple interpolation. 

Assume thal the values f, of a function f and ils deriv- 
atives /( (i 220,1, ..., m, k -:0,1,..., =, — 1) are 
given on the net А, aS To LKL.. L г< аі 


т 


+ | 
the nodal points r,, and, moreover, y а, = п 4 1. 


г-0 

We have Lo construct a polynomial H, whose values and 
derivatives up to the order о, — 1 at the nodes г, (i = 0, 
1, .. ., m) coincide with the values of f and its corre- 
sponding derivatives and to estimate the error. 

Interpolation of this kind is the interpolation in the sense 
of Hermite and the corresponding polynomial H, is the 
Hermite polynomial. The numbers о, are the multiplicities 
of the nodes х;. We can prove that the Hermite polynomial 
exists and is unique. 
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The remainder of the interpolation formula / (г) & 
Н, (х) can be represented as 


R, (2) f (2) — Н, (z) = 1529. [T (z— уч, 
—0 


(n-|-1)! i 
Ec (a, 0). (1) 
Assume now for definiteness that 
[7 (z) |< Mays, x Cla, 0). (2) 


Using this restriction and formula (1), we get the estimate 
of the error for a fixed point z: 


Mns Ш | 
A= |/(ж®)—Н„ (ж) I rr П 1-2 I. (3) 


It is now easy to construct an estimate, uniform through- 
out the interval [a, bl, for the fixed net Am. Indeed, 


= Mna 
М шақ ГА, (а) | S GEI max 19, (х) 1, (4) 


where 
m 
а, 
Q, (2) = [| z^. (5) 
Example. Construct the Hermite interpolating polynomial for 
the function f= 1 — соз (xz/2) using tho nodes z, = — 1 


тү = 0, т, = 1 with multiplicities a, = 1, a, — 2 and a, = 1 
respectively Get a uniform estimate of the error on the inter- 
val [— 1, 1]. 

A We calculate the values of the function and of its derivative 
at the given nodes: f (г) = f (z4) = 1, f (zy) = f’ (21) = 0. Then 
we construct the Hermite polynomial with due account of the 
multiplicities of the nodes: 


TEN u _ | 
Hy(2)=1- ZEP о. EEEN a er Domus 
Note that instead of a third-degree polynomial we havo got a second- 
degree polynomial. This is a consequence of the symmetry of the 

initial data (but not of the function /). 
Let us now find the estimate of the orror. Using formula (4) and 


bearing in mind that M, = (1/2)! for the function being consid- 
ered, we get 


X14 14 
^ «() varo mex 16-0) (2—1). 
i» *, 
It is easy to show that max | z + 1)22 (z — 1) | = 0.25. 
Therefore the final result із Д, < 0.065. А 
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7.16. Mathematical Apparatus of Trigonometric 
Interpolation 


In the sections that follow we consider the problem of 
approximating functions by means of a trigonometric 
polynomial. This means that we take a linear combina- 
tion of the trigonometric functions sin mc and cos nz as an 
approximating function. 

To give a formal substantiation of the choice of trigo- 
nometric functions as approximating functions, we need 
some knowledge from the course of analysis concerning 
the Fourier series. Below we give some data on the Fourier 
series omitting the proofs of the statements. 

Sequences. Series. Consider a function f (2). We tako the set of 
natural numbers as the domain of definition of this function, i.c. the 
argument т assumes tho values 1, 2, . . ., n. A function of this 
kind is called a sequence. 

A sequence is written in the form 

а. с, .. @nigy n» Ganep ++, OF {ал}. 


Неге а, is the general term of the sequence, a, ., is a term preceding 
а, and ал, is a term that succeods a,. 
Here àre some examples of soquences. 


(1) The sequence 1, 2, 3, ..., n, ... whose general term a, = 
n, is known as a natural scale. 
(2) The sequence а), aa, ..., Gn- Gns .. ., for which a, — 


an-ı = d, where d is a constant quantity, is an arithmetic progres- 
sion. To define an arithmetic progression, it is sufficient to know 
ils first term a, and the common difference d. Indeed, the general 
term is expressed by the formula 
a, = a, | d (n — 1). 

Since this formula can be used to find any term of the sequence by 
substituting tho values п = 1, 2, 3, ..., the sequence 1з consid- 
ered to be spocified. 

(3) The sequence b, by, ..., фы, Dns ..., for which 6, = 
84-17, where 4 is a constant quantity, is a geometric progression. 
To define a geometric progression, it is sufficient to know its first 
term b, and the common ratio q. The general term is expressed by. 
the formula 

bn = big”. 


(4) The sequence с), сз, . . ., сп, . - ., for which с, = с, where с 
is a constant quantity, is a constant sequence. 

(5) Hore is another example of a sequence. We shall calculate 
the number e in succession with one, two, three etc. digits. We can 
represent tho results of the calculation as 


2, 2.7, 2.71, 2.718, ..., 
(4), (2), (8), (4), зева 
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Labelling the values obtained by natural numbers, as it is shown 
in brackets, we get a sequence. 

In addition to number scries, we shall consider functional 
sequences. 

Here are some examples of functional sequences: 


(1) аҙ, ат, аҙ22,..., ал az 3, ..., 
(2) sin т, sin 27, sin 3z, ..., sin nz, ... 


Recall the definition of the limit of a number sequence. Tho 
number A is the limit of the sequence (ар) if for апу e >> 0 there is 
a number N such that the inequality | а, — A | < e is satisfied for 
all n> М. Then we write lim а, =A. 

Tn-0oD 

А :equence which has a limit is a convergent sequence, otherwise 
it is a divergent sequence. 

Example 1. Show that the geometric progression b, bg, bq?, . . ., 
bq"-1, ... is a convergent sequenco for | q | < 1 and a divergent 
sequence for |q [> 1. 

A (1) We shall first consider the case when | q | < 1. We 
shall show that 

lim bg — 0, 

л» ао 
i.e. proceeding from the given е > 0, we shall find N such that the 
inequality | bq"-! — 0 | < e is satisfied for n > М. To do this, 
we solve the inequality for n. We rewrite it in the form 


ІМ 1471 в, or |q|?7! « e/|b|. 
We take logarithms of the last inequality: 
(n — 1) In | g| < In (e/ | |). 
Dividing both its sides by the negative number In |q |, we get 


1а (g/151) . In (e/151) 
һ—4>— inu , ie. ">14-- ІІ” . 
Evidently, it is sufficient to take 
In (e/|51) 
N—E Aj, 
(7) 


where E (г) is the greatest integer not exceeding х, as М. 

(2) Let us now consider the case when g > 1, b > 0. We shall 
show that the sequence is divergent. To do this, it is sufficient to 
show that for any arbitrarily large M there із М such that the 
inequality bg^-! > М is satislied for all n > М. Solving this 
inequality for n, we get 


n>1+ ee 
We take 
_ Іш (M/b) 
ме (а) 
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Note that for q- — 1 the sequence is constant and lim 47-1 ~ b. 
1» ос 
We can show that in all other cases the sequence is divergent. A 
Consider а sequence aj, а, . . ., 4,,.... An expression of the 
form 


со 
S1 

ау |-а4-... +04... = У ап 
n—1 


is a series; here а, is the ath term of the series. 
The sum of the first » terms is its nth partial sum: 


n 
S5 Y aj. 


12-1 
The sum of a series is the limit of the sequence of its partial sums: 


“Пт $4,— S. 
7-00 
If a series has a sum, it is convergent, otherwise il is divergent. 
Пеге are some examples of convergent, апа divergent series. 
Example 2. We consider a series resulting from an arithmetic 
progression "nd saite its nth partial sum 


45-p-a&, . 2a, pd(n—1) _ d „| 241--4 
сигаи n—»n Sar 


Evidently, as n tends to infinity, its partial sum increases indefi- 
nitely in absolute value and, consequently, the series diverges. 

Example 3. We consider a series resulting from à geometric 
progression for | q | « 1 and find its sum. We use the formula for 
the sum of п terms of the geometric progression: 


83 := п. 





SoH 1277124" 
We have proved (see Example 1) that. lim P- © (Ig| — 1). : m- 
sequenlly, UT 
5 = lim 5, — =! . 
100 q 


Series whose terms are functions are functional series. Here are 
examples of functional series: 


ag- ayt- aat? +... an 411" 71 H- ..., 
b, b, cos z-|-b, cos 22 -|-... - рар cos (n -- 1) n ann 


The first of them is a power series and (he second is a trigonometric 
series. 


Let us consider a functional series 


иу (z) + ug (2 t+... tu, t+... 
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where и, e are functions defined on the interval |а, ^]. Let za € 
Гв, Ы, and then the series 


Uy (20) + ug (7) 4-...-- un (2) +... 


is a number series and may prove to be convergent as woell as di- 
vergent. 

The collection of all values of г € [a, b], for which the corre- 
sponding number series converges, is the domain of convergence of 
the functional series. 

It is evident that 


5 (2) = lim $5 (т), 


т 
where 8; (2) = У! u; (z) depends on the choice of the variable 
i—1 
z, і.е. the sum S (т) of the functional series is a function of the 
point z. 

Let {Sn (z)) be a sequence of partial sums of a functional series 
defined on the same closed interval (a, b). A functional series is 
uniformly convergent to the function S (т), defined on (а, b], if any 
е > 0 can be associated with a number М, independent of = € 
[a, b], such that the inequality | 5, (z) — S (т) | < eis satisfied 
for any n N. 

Consider ап example which illustrates the difference between 
the concepts of convergence and uniform convergence of a series. 


т 
Example 4. For Ше series > “азат. where üz zr <1, 
. n=-1 
the partial sum is 
n 


т 1 
-2)———-1———m. 
Sa €) 2 (1-2) (i++ 2)" 
We shall show that the series converges on the interval being con- 
sidered. 
Indeed, if z = 0, then S, (0) = S (0) = 0. Assume now that 
z > 0. We shall prove that in this caso S (г) = 1, i.e. using the 
given в > 0, we shall find N such that the inequality 
і 
(1+ 2)" 


is satisfied for n> М. Solving this inequality, we get 


N-E (ау). 


We can see from the last relation that in general N depends 
not only on e but also on z and increases indefinitely for one and the 
same в for z tending to zero. This means that proceeding (гот the 


|- -4|<е 
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given в, we cannot choose a unique № for all z € (0, 1], in other 
words, the series is not uniformly convergent on the indicated interval. 

This example shows that a sequence of partial sums continuous 
оп a closed interval may converge to a function discontinuous on 
that interval. One of the reasons for the introduction of the concept 
of a uniform convergence of a series is that a uniformly convergent 
series of continuous functions has a continuous function аз 118 зит. 

Expansion of functions in Fourier series. Many problems in 
science and engineering are connected with periodic functions which 
reflect cyclic processes. 

The function / (г) is periodic with period Т > 0 if it satisfies 
the equality 


f(z) = f(x Т). (1) 


For practical purposes it is convenient to represent functions of 
this kind as trigonometric series or their partial sums with suffici- 
ent accuracy. А 

A functional series of the form 


4 > (а, соз nz bg sin nz) (2) 


n=1 


is trigonometric, where a, and b, are real numbers independent of т. 
Assume that this scries converges for any z from the interval 
[—л, л], and then it defines a periodic function f (т) with period 
= 2л. 
А series of form (2) is known аз а Fourier series (ог the function 
f (z) integrable on the interval [~ л, x] if its coefficients сап be 
calculated from the following formulas: 


д 


.--. ) Í (т) dz, (3) 
В 

an | е) cos nz dz (n=1, 2, ...), (4) 
Рр 

= Vr sin nrdz (п=1, 2, ...). (5) 
-n 


We can formally consider the Fourier series for the function 
Í (z). However, the following questions arise: (1) whether the 
Fourier series converges for the function / (г), (2) if the series con- 
verges, then whether it has/ (z) as its sum. Dirichlet's theorem 
gives answers to these questions. Before formulating this theorem, 
we shall recall some concepts. 

The function | (г) із monotonic оп ап interval if for апу г, 
and za, which belong to this interval and are such that г, < z3, 
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only one of the inequalities f (ту) < f (za) and f (rj) > f (z,) is 
satisfied. 

The function f (г) is piecewise-monotonic on an interval if the 
interval can be divided into a finite number of open intervals in 
each of which the function is monotonic. 

The function f (z) is piecewise-continuous on an interval if it has 
a finite number of points of discontinuity on that interval. 

We designate the limit of the function f (z) when z tends to a 
from the right (right-hand limit) as / (a + 0) and, respectively, the 
left-hand limit as f (a — 0). 

Dirichlet's theorem. If the function f (х) given on the interval 
[— л, л] is piecewise-monotonic and piecewise-continuous, then the 
Fourie. series of this function converges throughout the interval 
[—x, л] and its sum is equal to 

(1) f (z) at all points of continuity belonging to (— m, x), 


(2) x [f (z — 0) + f (z + 0)) at ай points of discontinuity be- 
longing to (—n, n), 
(3) iU (—л + 0) + f (x — 0)] at the endpoints of the interval, 


i.e. at the points т — —z and т = д. 
In what follows we shall write that 


TOR A > (ал cos nz 4- b sin пт) (6) 
n--1 


in the sense of Dirichlet's theorem. 

Dirichlet's theorem does not assert the uniform convergence of 
the Fourier series.to the function / (г). However, if we strengthen 
the properties which the function must satisfy, i.e. require that it 
should be continuous throughout the interval [— л, л], piecewise- 
monotonic on it and that the equality f (— л) = f (л) should be 
satisfied, then the Fourier series for such a function will converge 
uniformly to the function f (z) throughout the interval [— л, лі. 

We can show that for an even function all the coefficients b, are 
zero and the corresponding Fourier series does not include sines: 


f(z abt > аһ COS пт, (7) 


т--і 
жһеге 


alr 


ар = 1 (2) соз пт йт (п = 0, 1, 2, ...). (8) 
0 
Similarly, for an odd function all the coefficients а, are zero and 
the corresponding Fourier series does not include cosines 


{(z)= ХУ bn sin nz, (9) 
n=1 
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where 
2 PLI | 
bn = е ) f(z)?sinnzdr (n-=1, 2, ...). (10) 
Ü 
Example 1. Represent the function 
_f —2z flor -л<:<, 
f(2— 2z io | Ө<т<л 


as a Fourier series. 
^ We find the Fourier coefficients of the function / (ғ). From 
formulas (3) and (4) we find tho coefficients ag and a,: 





9 л 
-л 0 


0 : 
1 r 1 0 
an \ (— т) cos nz 4г---- | 2r соз пт (1 е. 
-3 0 
Integrating by parts, we obtain 


0 





1 (rr т 1 Ca ] 
an - — — | — n: ---- nnrdz 
А -(- т \ sin г 
-л -л 
л 
2 . 2. 
-———rsinnr|-[-— sinnzdz) 
n n 
0 0 





0 л 

1 1 2 

<------ (--сояпг | —— cos пт 
дп n n 








3 
)-— u-0 omn 


-л 0 
і.е. 
6 4 
—ameeap 055 222. 


The coefficients b, can be found from formula (5): 


4,5-0, Agha 


д 
1 "A 1? А 
bya = x ) (— х) sin nz dx "x \ 2rsinne dr 
-1 9 
0 л 
4v 





+— \ cos nz dz 


23—0104 
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4-22. cos nz [-*| cos nz dz) 
n n 9 
=+ 2а 1 | oO 


1 1 
Uy, = —-3rs baa ag 067152 83 ...). 


Thus the Fourier series of this function has the form 


f= n— > укчу ов (2&—1)хт 
һ=1 


oo 
+ > XT sin (2k —1) z- £3 — sin 2Ёт. 
һ-і k=1 


In the interval (--л, л) the series converges to the function f (2) 
and at the points z = +7 to the number 


3 (—2--0)--f (3—9) = 3 л. A 


Example 2. Hopresent the function 
=©={ —sinz for -л<т<о, 
sinz for О<т<л 


as а Fourier series. 
^ This function is even and, consequently, all the coefficients 


bn == 0 and а, can be found from formula (8): 


2 
an = —— \ зіп тсозптйт (л--0, 1, 2, ...). 
0 


From this we have 


л 
21. _ 4 
do — —— | sin z dz- ua 
0 
Furthermore, 
л л 
2 . 1 . | 
n= ( віп т cos nz dz — —— ( [sin (n 4- 1) = — віп (п — 1) z] dr 
0 0 
| 0 for n=2k—1, 
= 4 
"““а(п%--4) for n—2k (k — 1, 2, 3, ceeds 
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Consequently, 
a 


А 2 4 1 
Р(х) == |sin z| — Жл > тат соз 2kz. 
h=1 
Note that the series obtained converges to the function | sin z | 
throughout the interval |-л, a]. 
Example 3. Represent tho function 


—1 for --л<ст<0, 
rel u for 2—0, 


1for О<=а<л 
as а Fourier series. 
A This function is odd and, consequently, all the coefficients 
а, = 0 and b, сап be found from formula (10): 


л . л 
' : 2 2 
а = \ 1.sin nz т = — A COS nz =n {4—(—14)"]. 
0 0 
Thus all the even coefficients b, are zero and the odd ones have 
the form 9;ң-1- A Consequently 
% л (2k -- 1) ” 
how 4 
Қа) = > > рр Sin (2k— 1) т. 
h—1 
Evidently, at the points z == О and z = + n the sum of the series 


is equal to zero. 

Example 4. Hepresent the function 
f a for Oz « 1, 

f(z) 4 1 for 1<<:<<2 

as а Fourier series. 

A Since the function is defined in an interval different {rom 
(- a, л), we make a change of the independent variable using the 
formula z -> (z^ |-л)/л, ora’ -= л(г-- 1). Thus we get a function 


1 , , 
— {С -j- --- 1! 
rend xU рл) for -a<r <i 
1 for YEr л. 


Since this function is defined in the interval (— л, л), we can write 
a Fourier series for it. Wo calculate the сос ісіспіз of this series; 





0 л 
at (л, drn” 
0 \ ~; at Tu 1-4т — 
Jn A 
0 ‚ л 
2. M т”-Ыл . , (LÀ. ( ; , 
аһ т \ a cos nz' dz’ -| a \ .*созтт dr 
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0 
1 e" , 1 
=- \ sin nz' dz' ——,3- [1 —(—1)"|, 
-л 
1 + NE 
һ--- \ ы = X ginnz' dx! -|--—— ) 1-віп nz' dz' 
-n 0 
0 n 
= ) z' sin nz' dz’ = 0", 
л лл 
-л 
Consequently, 
2 
19-3. Tu Rk M cos [(2k — 1) x (z— 1)] 





h—1 
xA P sin [nn (т — 1)]. 

We calculate the values of the sum of tho series al the endpoints of 
the interval: * 


jurorem AT. 


—. 
The result obtained makes it possible to lind the sum of the num- 
ber series . 


-€ 4 1,4 1 


Indeod, on the basis of Dirichlet's theorem, for z = 0 or z = 2, 
we have 


1 2 = 
Tob (2k—1) E , 


whence it follows that 


1 л? 
уу ‚ Grip eA 


It should be pointed out in conclusion that the integral of the 
function f Н: results from а term-by-term intogration of the corre- 
sponding ourier series and the derivative /” (т) can be obtained by 
means of а term-by-term differentiation. The condition f (— л) = 

{(x) is obligatory in differentiation. 
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7.17. Trigonometric Interpolation 


The operation of representing the function / (х) as 
a Fourier series is known as a harmonic, or Fourier, analy- 
sis. In practice, we have to restrict our computations to 
the first few Lerms of a Fourier series. As a result we get 
only an approximate analytic ex pression for the function 
j (x) in the form of a trigonometric polynomial of or- 
der М: 
N 
Оу (x) — E IE > (а, cos nz 4-0, sin пә) 
n=1 


(лаа). (0) 


Beside Миз, formulas (3)-(5) from 7.16 are suitable for 
calculation of Fourier coefficients only in the case of an 
analytic representation of the function. [n practice, as 
a rule, the function f (x) is given in tabular form or as 
a graph. Tiarefore a problem arises of an approximation 
of the Fourier coefficients with the use of a finite num- 
ber of the available values of the function. 

Generalizing all we have said above, we shall formulate 
a problem of the numerical, or, as it is also called, har- 
monic analysis: we have to approximate, in the interval 
(0, T) by the trigonometric polynomial of order N, the 
Іше Lion y == f (2), for which we know m of its values 

n = f (£r) for x, = Тт (k == 0, 1, 2, ..., m— 1). 

"A trigonometric polynomial for the function delined on 
the interval (0, 7) has the form 

N НД 
Ом (x) = EI [- У (an cos n Ft bs sin n = 4). (2) 
n=! 
The coefficients a, and 0, are delined by the following 
relations: 
а Т 
ün — 2. Tio сөзі 7 T de, (3) 


(п- 0,1,2,..., М). 


о 


1 
ba: c] f (z)sinn Frade, (4) 


358 Computational Mathematics 


Employing, in (8) and (4), the rectangular formula for 
calculating the integrals from the values of the integrands 
at the points 7, = ЕТ/т (k = 0, 1, 2, ..., m — 1), we 
have 

m-1 


2- 2nk 
ад = > Уһ COS n= , (5) 
һ=0 
(п--0,1,2,..., М). 
m-1 
2 А 21k 
bn = — > yy sin n ZE, (6) 
k=0 


Thus the trigonometric polynomial (2) whose coeflicients 
а, and b, can be found from formulas (5) and (6), serves 
as a solution of the problem posed. 

We can show that for m > 2N polynomial (2) is Шо 
best approximation of the function f (x) in the sense of the 
method of the least squares if its coefficients are calculat- 
ed from forinulas (5) and (6). To put it otherwise, cocflici- 
ents (5) апа (6) minimize the sum of the squares of the 
deviations 

m-i 


ÔN = д [Qn (zi) — y. P. (7) 


In a special case, when m = ОУ, the coefficients а, and 
b, (n —0,1,2,..., N — 1) are defined by relations (5) 
and (6) and Ше coefficient ay is 


m-i 
w= У (—1 ys. (8) 
=0 


The polynomial Q y (z) itself becomes an interpolating 
polynomial since in this case, for any 5 y, there hold rela- 
tions Qy (т) = Yn for all т, = kT/m (k —0,1,2,..., 
m — 1). 


Example. We investigate tho dynamics of the production of 
sugar from sugar-beet. This production is of a periodic nature which 
is due to the periodiciLy of growth and the conditions of preservation 
of raw material. Therefore, we can take the trigonometric polyno- 
mial (2) for т = 12 as a function approximating the dynamics of 
sugar production. (This corresponds to the number of months in an 
annual cycle and makes it possible to rovoal the peculiarity of tho 
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production, its seasonal nature.) Consequently, 
N 
Ом (2-4 > (an cog п-6-2 -|- 5, sin һ-5- z) (D x zx 11). 
n—1 
In economic investigations, not more than four harmonics are 
usually chosen for a good approximation of a dynamic periodic 


series. 
The expressions for tho coeffficients а, and b, have the form 


11 11 
1 л 1 А л 
an U6 » Yh COI N -y Thy ba > уһ SIN -y Th. 
һ=0 һ-0 


We calculate these coefficients for tho first four harmonics of the 
polynomial Qy (z) and tabulate the necessary computations (see 
Table 7.13). 

From this tablo we find that а, — 108, a, == 34.99, a, — 7.15, 
4472— 3, ø= - 1.25, b, = 0.14, b, = --11.98, ba = —4, 
б, 1.59. Thus we have the following four mathematical models 
of the seaz;na. ualure of sugar production: 


01 (z) = 54-4- 34.99 cos à z --6.1l sin E z, 


0, (х) = 54 |-34.99 cos 4 x- O.1l sin > z -|- 7.15 cos Az 


— 11.98 sin E т, 


Оз(г)-:54--34.09 cos 2 z-- 6.11 sin Ac 4- 7.75 cos + г 


‚л л . n 
— 11.98 sin ES z--3 cos —5- 2--4віп —5- т, 
T 


Q, (7) -= 54.]-34.99 cos = z— 6.11 sin X z-|- 7.15 cos - x 


3 


11.98 sin -5-2--Әсоз-5- гд зіп 5-1 


2л .. 2A 
—1.25 соз 73- z-|-1.59 sin 77 T. 


When we compare Q; (zn) with the respective values of yp, we 
seo that already the first harmonic yiclds, in general, a correct mod- 
el of the dynamics of sugar production, indicating its seasonal 
nature. 
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Let us calculate the mean quadratic deviations 8;-- 


I 
V 5 [Qi (zx) — уһ]? for all 0; (2). We find that 6,==37.80, 
h-0 


6, — 14.40, 6, — 7.59,6, — 5.75. As would be expected, the val- 
ues of 6; decrease monotonically with an increase in i, 6, differing 
but little from 6,. In addition, the values of 6, and 6, themselves 
are small and therefore the polynomial Q; (г) is already a close 
approximation of the series which characterizes the annual dyna- 
mics of sugar production. 


7.18. Numerical Methods of Determining the Fourier 
Coefficients 


Consider a Fourier series converging lo the periodic 
function f (2): 


f(e) = a 4- > (Gp, cos ma -+ b,, sin mz), (1) 
m=i 
where 
л 
аш = | f(z)cosmzdr (т--0,1,2,...), (2) 
-л 
m 
b, = i | f(z)sinmzdz (т. 1,2,3,..). (8) 
т Л 


In the preceding section we forinulated a problem of 
approximation of the function f (х) by the trigonometric 
polynomial Q y (x). We used there the rectangular formu- 
la to calculate the coefficients am and bm with the aid of 
integrals. 

In the general case, the approximation of the coefficients 
ат and bm is based on the replacement of the integrals in 
forinulas (3) and (4) from 7.17 by their values obtained 
from one of the formulas of approximate integration. Іп 
this section we shall use the trapezoid rule. 

We assume that the function f (т) is periodic with peri- 
od 2л. Note that when determining the coefficients ақ and 
bm, we can consider any integration interval 2x long 
rather than the ordinary integration limits from --д 
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to л. To make the calculations more convenient, we take 
an interval from O to 2л so that 


2л 
Om == | f(z)cosmzdx (m--0,1,2,...), (4) 
0 


2л 
Dm = i | f(r)sinmzdz (m—1,2,3,...). (5) 

0 
Dividing the interval [0, 2л] into N equal parts, we 
get division points 0, 1.57, 2.25, ..,, (v — 27, 
2x. We designate the corresponding values of the function 
f (x) al the division points as yo, Yis Vos UN Ум = 
Yo. Applying the trapezoid rule, we get the following 
approximate formulas for the calculation of the сөсПісі- 

ents аы and ! 











N-1 
N 
72 de = У Yn- Yo byt. ІЗУм- 
h-- 
y ^ 2 2 
P дтл тл 
72 lm Ы > Уһ COS k N Yo 1-10; COs N d 
k -0 
ә 
‚+ d] yy aU 05 (№ -- 1) = , 
N "a 2 2 
H . тл . тл 
Fm- > У, зіп Еу = sin у d 
А-а 


o Yasin (N — 1) 288. 


Assume that V = 12, i.e. the interval 10, 2z] is divid- 
ed іцо 12 equal parts so that we use the values of the 


argument 0, л/б, л/3, ..., 1142/6, associated with the 
values of Ihe function yg, Yi Уә... Yip and the values 


by which these values are multiplied are + 1, 
+ sin (л/б) = + 0.5, + sin (л/3) = + 0.866, From this, 
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omitling cumbersome computations, we obtain 
6a, — Yo йу А-У» 4 уз V Ys T Ys tY tyr Уво Hot Ja 


ба, = (y, 4- Vio — Y, — Ys) sin * 
+ (Y, -F Yr Ys — ут) Sin E +(Yo— Je); 
ба, = (Ji A- Ys -H Vi -+ Yu — Va — Vy — Yo— Yio) зін 
4: (Yo -F Ye — Ya — у), 
баз — tho + Ya Ч Ya— уз — Ve — Vio 


65, = (y1 -H Ys — ys — Y1) Sin A 
+ Qs Ya — Vs — yao) Sin % -- (ya — Y9)» 


65, == (y, Yo d. Vs 4-Ya— Ya — Js — Vio — Ун) sin A , 
65, = V, -+ Ys + Vo — Ja — Vi — Vi 
and so on. 

To minimize the number of arilhmelic operations neces- 
sary to obtain the values of «,, and bm, we use a special 
computing scheme known as Runge’s scheme. 

1st step. We write the values of the function f (c) in the 
following order: 

Yo Yı Уз Us Ya Us Ув 
Vii Yio Yo Us Ут 

2nd step. We calculate the sums and the differences of 
cach pair of values which are under each other and write 
the resulting sums and differences as follows: 

Yo Уу Уг Уз Ya Vs Ув 


Ui Vio Yo Ya Ут (6) 
sums Шу Шү Ug Uy U, Ug Ug 
differences г, Uz Ug 0, Us 


3rd мер. We perform similar operations with Lhe sums 
and differences (0): 
Up Uy Uy И; Uj Ug Ug 


Ug Us Uy Ug Ui (7) 
sums Co Су Cz Cy Ву Ra Ёз 


differences d d, d, hy h 
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Ath step. We calculate the values of am and bm using the 
approximale formulas 
ба, = Co + € + -- Cas | 
ба, = d, + 0.8664, -|- 0.5d,, 
ба, = (ey — са) 1- 0.5(e, - - сә). 
62, = d, — d,, (8) 
бр, = 0.5g, -| 0.8660, | £y 
00, = 0.866(h, — А), 
00) = £y — £s, 
and so on. 


То compare the coefficients а, and bm obtained from 
approximate formulas with their exact values, we give an 
example in which the function is represented analytically, 


Example. Consider a periodic function with period 2л: 


гіл for 0 xz z «zm, 
y f(t) 4 1 Їїогл<хтх<2л, 
0 for r—2n. 


We compile a tablo 












































a, Lo [E] m | 2n] 57| | 72] 4n | 3л) 52 [Ma] o. 
h 6|13,2|3|8 6/3 2|3]|6 

оа ааа ваа [а а [ето 
Уһ 613121316 | 














In accordance with Пипрде'з scheme we write the values of уһ and 
earry out the additions and subtractions indicated in it [sce for- 
mula (6)]: 


1 1 1 2 5 

"059 30% 7 T! 
1 1 1 1 1 
7 4 3 5 44 

sums 0 ч uw uy ES ai 
diffe 5 224 % 4 
ifferences eS —3 2 3 6 
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Next we perform subtractions and additions with respect to the 
sums and differences obtained [sce formula (7)]: 


sums differences 
0 L 4 38 5 2 1 
6 3 2 6 3 2 
(4. 5 SA 0 
6 3 5 3 
sums 1 3 3 2 sums —1 —1 -- 
differences —1 -5 -4 differences -— -- 
Then we write the expressions for am and bm: 
025: 1--3--3-4-7- , 6b, = 0.5 0—4) 4-0.806 (—1) 3, 
2 . 1 , з 2 1 
6a, = —1 —-5 -0.866 0.5.2, 0b, = 0.866 (-а-з) ; 
3 1 
ба,- (1—-у)+"5@--э), 6b, -1-(-4) | 
4 
w=- (74). 
Tence 
а, = 1.417, a, = — 0.291, a, = — 0.083, a, --- 0.111, 
b, = — 0.341, b, = — 0.144, b, = — 0.083, 


To make the comparison, we give the exact values of the coef- 
ficients: 
а = 1.500, a, = — 0.203, а, = 0.000, а; = — 0.022, 
b, = — 0.318, b, = — 0.159, b, = — 0.106. 


To obtain more accurate values of the coefficients from 
approximate formulas, we can use schemes witli a larger 
number of ordinates. 

Note that the practical harmonic analysis makes il possi- 
ble to obtain analytic expressions which would approxi- 
mate the given functions with the least mean square error. 


7.19. Backward Interpolation 


]nterpolation of functions proves to be a useful appa- 
ratus in problem solving. The problem of determining 
à root of an equation or a root of a function is a typical 
example of the use of an interpolating polynomial. 
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Consider the following problem of backward interpola- 
tion. А function f (т) continuous on the interval (а, 5) is 
specified on the net Ag: ax; ...xL Ip... rg < 
ee OOS... Oby its values f; (i = 0,4+1,..., 
+k). We have to find the value of the argument 
r* Є (£o, ту) corresponding to the specified value of the 
function f* = fy + Ө (7, — fo), 9 Є (0, 1). The interval 
(х0, zı) is assumed to be so small that 2% is unique. 

In essence, we have to find here the root of the equation 


f (ж) = f*. (1) 


One of the possible ways oi solving this problem is the 
following. We approximate the function / (x) by its inter- 
polating polynomial P, (f, х) and replace equation (1) by 
the equation 


P, (f, 2) = /*. (2) 
We lind Ше real root z* of equation (2) belonging to the 
interval (го, zı). For all practical purposes we get only 
an approximate solution of equation (2), i.e. the value z*. 


Now we assume that z* — z*. 
Let us estimate the error of this solution. Assume that 
the total error of interpolation is A, i.c. 


ІР, (f, 2) — f(x) | ^ (3) 
and the error of the solution of equation (2) is е, i.e. 
[z* —z* |< e. (4) 


Then the increment of the function f al the point z* can 
be represented as 


f* — f (а*)— (2* — 24) f' (Б), E— т* 4-0 (z* — z*), 0 €(0, 1). 
From this, with due account of the fact that f* — 
Pa (f, т”), we have 

Р, (f, z*) — f (2*) = (2* — z*)J (B). 
We assume now that min | (x) | =m, 0, 


and, using estimate (3), we obtain 


|z* — a* |< A/m,. (5) 
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Furthermore, 
[a*t | = at E28 2 | «c | a — zh | + | i8 — 2| 


and, by virtue of inequalities (4) and (5), we finally get 
| = А 

* o — J- ) 

| z*— x < +e. (6) 


Thus, both the solution of the problem posed and crror 
(6) are defined by two processes, the construction of an 
inter;olating polynomial and the solution of equa- 
tion (2), i.e. the search for the roots of the interpolating 
polynomial. 

These two moments may seem to be unrelated. This 
is not so, however. 

It should be borne in mind that a rise in the degree of 
ihe polynomial decreases tho error А on the one hand and 
increases the labour needed to solve equation (2) on the 
other. 

Therefore, the degree of the interpolating polynomial 
must be the lowest in order to achieve the required accu- 
racy. 

In the practical solution of a problem of backward in- 
terpolation on a uniform net, Stirling's and Dessel's po- 
lynomials are usually taken as interpolating polynomials. 
In that case, equation (2), written with respect to the 
variable t = (т — х,)/й, is reduced to the form t = 
p (f) and is solved with the use of an iterative 
method. 

When using Stirling's polynomial, we have 


t= tT ho e-ti e...) (7) 


The use of Bessel's polynomial gives 
n a d (paf Mile yy 
t= 2 + fils (^ Bf ya a L( 1) 
fi 4 
— Ja (=) ((—1)— ...). (8) 


As the initial approximation [9 we take um Ut — hn) 
у 








in the first case and 0.5 ог i quz * ufu) in the 
“2 
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second case. When 1%, which is the solution of equa- 
tion (7) or (8), is obtained, 2% can be found from the for- 
mula z* = хо + ЖИ, 

Similarly, if a necessity arises, we can get a solution 
of the sel problem by means of Newton's first or second 
interpolating polynomial. 

Let us consider the second method of solving a problem 
of backward interpolation based on the existence of a 
function g (y) which is the inverse of f (x). 

Assume that the function g (y) is continuous with a suf- 
ficient number of its derivatives on a minimum interval 
containing the values y; = f; (i =0, +1, ...) and 
y* — f*. In this case the search for z* is equivalent to 
the search for the inverse function g (y) defined by its 
values z; al the nodes y;, at the point y = /*, since 
x* = g (f*). 

We have thus reduced the given problem to the prob- 
lem of interpolating the inverse [unction g (y) and 
calculating g y“). 

This method of solving a problem of backward interpo- 
lation is more efficient than the method which includes 
a solution of an equalion as one of its stages. lt is espe- 
cially convenient when we have to lind a solution оға prob- 
lem for a large number of values /* or to obtain an 
explicil expression for the root of equation (1). The 
drawback of the second method is the requirement that 
a smooth inverse function should exist, a condition 
which cannot always be fulfilled (for instance this require- 
menl. cannot be satisfied for nonmonotonic functions). 

It should be pointed out in conclusion that Lo calcu: ite 
1% by means of an inverse function, Ailken’s iterative in- 
Lerpolation presented in 7.13 is most convenient. 


Example 1. Using the table of values of the function / — 3* giv- 
en in the example in 7.9, find out the value of the argument z* to 
which the value of tho function /* = 5 corresponds. Estimate the 
orror. 

A In the example in 7.9 the order of correctness of the iuble 
is 3. Since this value of /* is at the end of tho table, it follows that 
to calculate z*, we must use Newlon’s second interpolating polyno- 
mial of the third degree. Setting ry = 1.50 and £ = (x — z,)/h and 
using formula (10) from 7.9, we get an equation for determining ¢*: 


1.248 0.300 0.072 
5--0.196----- tF ШЕТШ 1 (t+ 1) [-- 3l 





‚ 0-1-1) (4-1-2). 


24—0104 
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Taking into account the results of the example from 7.9, we 


calculate the error of the value of z* from formula (5). Since А := 
A, + A, = 0.004 and m = min | 3* In 3 | = 2.5, the 
(0.75, 1.5] 


required error constitutes | z* — 1" |< A/m, = 0.0016. 
We reduce the equation for /* to a form convenient for the use 
of an iterative method: 


5—5.196 4 0.300 0.072 
t= Tose Lar EP Oa (00-2 | 
and solve it taking 2; = (5 — 5.196) + 1.248 = — 0.16 as the 

initial approximation. Then 
1 0.300 


t= —0.16— 77 бир (— 0.10) (0.84) 
от (— 0.16) (0.84) (1 84) | = —0.441, 
‚ 4 0.300 А 
t= —0.16— 7 [sr (—0.141) (0.859) 
0 .t 
+742 (— 0.441) (0.859) (1.859) | = --.143. 
We can thus take the value 2% = — 0.14 + 0.003 as the approx- 


imation of the solution of the equation. Hence 


z* = ay + t*h = 1.465 


and the error of the solution of the equation 
. |z* — z* | — к « 0.0008. 


Thus the final solution is z* — 1.465 + 0.003. A 

Example 2. Using the table of values of the function / — In z 
given in Example 1 in 7.13 (see p. 340), calculate e? with an accura- 
су of 0.01. 

А The function f has an inverse g (y) — cV which is continuous 
together with its derivatives on the interval (- oo, oo). We сап 
therefore reduce the calculation of eY to the calculation, at the point 
y = y* = 2, of the function e" given as a table 


y | 0.00 | 9.69 | 1.39 | 1.61 | 2.08 | 2.3) 

g | 1 | 2 | 4 | 5 | 8 | 40 

We use Aitken's method to solve this interpolation problem. 
We enumerate the nodes y, as follows: y, — 2.08, y, — 2.30, y, — 


1.61, уҙ = 1.39, y, = 0.69, yg = 0.00. Using now formula (1) 
from 7.13 and replacing г by y and г, by ym, we calculate the val- 
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3A 


ues of the interpolating polynomials P, (y*): 


1 


—0.08 


8 





PY (2)= 7-55" —0.30 40 =: 7.27, 
pp (2) = cis. 0 al 2-49, 
PP буз ре | eun pag [778 
РР 2) = [ys 86-77. 

Ру (=r long 7017-41. 

Prom TM rM. 


Since | РО!" (2) — P9!? (2) | -= 0.01 and the required accuracy 
is attained, we terminate the calculations and set e? = 7.38 + 
0.01. A 
Exercises 


1. The function y — f (x) is given as a table 
т | 1.522 | 1.523 | 1.524 
y | 21.471 | 21.916 | 21.354 


Find its value at the point r — 1.5228 using Newton's first 
interpolation formula. 


2. The function у / (x) is given as a table 


1.529 | 1.53) | 1.531 


“| 


| 23.911 





y 24.498 | 25.115 

Find its value at the point r -: 1.5303 using Newton's second 
interpolation formula. 

3. Construct Lagrange's interpolating polynomial for the func- 
tion given as a table 


т | -? | 
| = 


4. Construct Lagrange's interpolating polynomial for the func- 
tion / (г) = e-* if the points ғ, = 1, т) = 2, г, — 3 are interpo- 
lation nodes. Estimate the error for x = 1.5. 

5. Compile a table of finite differences for the function given 
as a table 


—1 2 | 3 


--12 5 





5 | 
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6. Compile a table of divided differences for the function given 
as a table 
т | —3 | 1 | 0 | 2 | 3 
y | - | -т | 4 ls | 47 
7. For the function y == / (г) given as a table 
т | 1.03 | 1.08 | 1.046 [123 | 1.26 | 1.33 | 1.30 


y |2.80107 | 2.94468 | 3.18993 | 3.42123 | 3.52542 | 3.78104 | 4.04485 


calculate the value at the point z = 1.21555 with an accuracy of 
10-5 using Aitken's method. 

8. Using Stirling's formula, find the value of the function 
y = f (т) at the point г = 1.34627 if the function is given as a table 


х | 1.335 | 1.340 | 1.345 | 1.350 [1:335 | 1.360 


у |4.16206 | 4.25562 | 4.35325 | 4.45522 | 4.50184 | 4.67433 
9. For tho function given as a tablo 
х р 244% | 1-440 | 1445 


y | 0.892687 | 0.893008 | 0.894700 


determine the value of the argument corresponding to the value 
of the function 0.892914. 
10. Use the method of backward interpolation Lo find, with an 


accuracy of 10-5, the root of the equation J'z -|- 1 -- == 0 which 


lies on the interval [0.7, 0.8]. 
11. Construct an interpolating polynomial for a function 
given as a table 


т | 1 | 2 | 3 
y | 384.6 | 507.9 | 477.9 


12. Construct an interpolating polynomial for a function given 
as a table 


т | 1 | 2 | 3 
y | 349.4 | 416.9 | 430.6 


13. Calculate the value of tho function f (г) at the point т = т, 
using a requisite interpolating polynomial and employing four- 
digit tables of trigonometric functions with the stepsize of 1°. 
Estimate the absolute error of the result in the following cases: 
(a) f(z) = sinz, zı = 37.7, (b) f(z) = cosz, zı = 19°48’, 
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(c) f(r) sin т, zı = 53°12’, (d) у (х) = cos т, т) = 86248”, 
(e) / (£) = cos г, т, = 7190”, (f) / (г) = tan г, гу = 67°48’. 

14. Set up a trigonometric interpolating polynomial for the 
function y — / (т) defined in the interval (0, л) and given as a ta- 
blo of values of yn = f (rn): 





k | n | 1 | 2 | 3 
zh | а | л/4 | n/2 | 32/4 
Yh | 1 | 2 | 2.4 | 2.6 


15. Set up а trigonometric polynomial of the order not lower 
than the second for the function y == f (т) defined in the interval 
(0, 1) and given as a table for the values of ук = f (zp): 


e ofai fala la jos 
| 











1/6 | 1/3 | 1/2 | 2/3 5/6 





SETI 





Ic 








Chapter 8 


Numerical Differentiation 
and Integration 


8.1. Statement of a Problem and the Basic Formulas 
for Numerical Differentiation 


When solving practical problems, it is often necessary 
to obtain the values of the derivatives of various orders 
of the function f given as a table or as a complicated ana- 
lytic expression. In that case a direct use of the methods 
of differential calculus is either impossible or difficult. 
Then use is made of approximáte methods of numerical 
differentiation. 

The simplest expressions for derivatives result from 
differentiation of interpolation formulas. 

Consider the following problem. The values f; of the 
function f, continuously differentiable n + 1 + m times, 
are defined on the net а< x, < д <... xr, x bat 
the nodal points z;. We have to find the derivative 
189 (x*), z* € [a, b] and estimate the error. 

One of the possible methods of solving this problem is 
the following. Using the nodal points г; (i = (), 1, . . ., п), 
we construct fór the function f an interpolating polynomi- 
al with the remainder A, such that 


f (2) = P, (г) + Rn (т). (1) 


We differentiate the right-hand and left-hand sides of 
relation (1) m times and set т = z*: 


№9 (z*) == Py? (z*) + Ry" (z*). (2) 


For sufficiently smooth functions, i.e. for functions with 
bounded derivatives, sufficient number of nodes and suf- 
ficient accuracy of calculations, the quantity RE" (7%) is 
small and 4!" (2%) is a good approximation for /С” (z*), 
and so we can set 


[“® (z*) e Py" (z*). (3) 
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In practical computations, numerical differentiation 
proves to be very sensitive to errors in the initial data, 
to the discarding of terms of a series and other operations 
of this kind. In addition, the high accuracy of interpola- 
tion the [smallness of Д, (z)], does not guarantee a high 
accuracy of the interpolation formula for the derivatives 
[the smallness of AY” (z)]. Therefore one must be care- 
ful in applying the methods of numerical differentiation, 
using it, as a rule, for small m. 

Bearing in mind all we have said and also the fact that 
the calculation of derivatives of higher orders can be 
reduced to a successive calculation of lower-order deriva- 
tives, we shall consider in more detail the technique of 
obtaining formulas for computing f’ and f” at the nodal 
points of a uniform net. To obtain derivatives at the 
nodal points, it is expedient to use Stirling's interpolat- 
ing polynomial and ils remainder [see formulas (5) and 
(6) in 7.81 Thus, differentiating Stirling's polynomial 
and its remainder with respect to z and setting r* -= 
ro (t* — 0), ме get the following expressions for the 


derivative: 
f (a) = х Lufi M2 ne (61), (4) 
М, 


Р (2) = (Hh м ES 6-3. @® 


Differentiating Stirling's polynomial twice with re- 
spect to z and calculating the value of the second deriva- 
tive at the point z* = z,, we have 


" 1 Мау ) 
f' (2) = oe fi ge (6-10), 9 
м, 


Р) (i амен с). 0 


The derivative at the exact middle point between the 


ка 














Hy can be calculated with the use of 
Bessel’s polynomial. In this case the appropriate formulas 
for the derivative have the form 


/' (n) fus т 0), (8) 


p (st) ed (e deo) eee eem. m 


nodes r* -= Xo 
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Of practical interest are the so-called formulas for onc- 
sided differentiation which make it dir an to calculate 
f (x) using the nodal points z; = =, -|- ih (i = 0,1, .. ., 
һ,... or i=0, —1,..., —k,...). It is convenient 
to set up these formulas with the use of Newton's first 
and second interpolating polynomials. 

Differentiating Newton's first polynomial with respect to 
r and calculating the value of the derivative at the point 

= ry (t = 0) for k = 1 and k = 2, we get the formulas 


F (2) = Afo + £ Mph, (10) 
, 1 1 1 
I (ш) (А А) Ey MAT (И) 
respectively. 
Similarly, differentiating Newton's second polynomial 
for k = — 1 and k = —2 we obtain 
f (29) ==4- Vf, + 1- М), (12) 


А 1 1 
PG) (Vhd- 9%) xa MAU (13) 
respeclively. 


8.2. Peculiarities of Numerical Differentiation 


Here we give again а]! the second-order formulas ex- 
pressing finité differences appearing in them directly iu 
terms of the values f, of tho function. From relations (4), 
(6) and (8) from 8.1 we have 





Р (д) = Bl + Зарр, (1) 

-- - М 1) € 

f(a) = h— „Жее, 0) 
п) арален m 


Helations (11) and (13) from 8.1 yield, respectively, 
formulas 


Р б) = (= 35-41 М8, 04) 
| f(Gm)-a 4. b) 09) 
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We сап see from the formulas given above that the 
error of the method diminishes with a decrease in the 
stepsize of the nel. However, if the values /; of the func- 
tion are given approximately, say, with the same ab- 
solute error e, then the total error of the formulas for 
numerical differentiation will include an additional 
term which is inversely proportional to A" (m is the order 
of the derivative). Therefore, it is reasonable to decrease 
h only to a certain limit. 

To illustrate the aforesaid, we shall consider the right- 
hand side of formula (3). [ts total error constitutes 
М, уу 2€ 
ой M d 4. (6) 





А “т 


Equating A‘ (А) to zero, we get the point of extremum of 
the function A (A): 


23/4 yg d fe 
h2 Y Fe BLO uw (7) 


Since A” (kh) > 0, it follows that Ay ік the point of 
minimum of A (А) and 


A (h) -2 V alee e V We. (8) 


This relation means, in particular, thal we cannot guar- 
antee, for any А, that the error of the result will be the 
quantity o (e?”). 

Similarly, using formula (2) for the oplimum stepsize, 
we gel an expression 





КӨРЕТІН pí Е ! 
29 ~ 9 25. П 
“V MW = 2-6 V М,” (9) 
and, using formulas (4) and (5), we get an expression 
; EN 
hy] LEE Vx. (10) 


Thus, when calculating derivatives, we must first’ find 
the optimum stepsize of tho inilial table of values f,., 


Example 1. Calculate /' (1.6) and /" (1.4) for the function f = 
In z given as a table 


T | 1.2 | 1.3 | 1.4 | 1.5 | 1.6 


г | 6.1923 | 0.2626 | 0.3364 | «0.4054 |] 0.4700) 
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which contains the values /; with all valid values in tho broad sense. 
Evaluate the error of the result. 

А To calculate the required derivatives, we apply formulas (5) 
and (2) respectively. Then, using relations (10) and (9) and the 
initial data, we get the following values for the optimum stepsize: 
3 6- 1071 

9.73 


à f 4B. A74 
2.1 


Since the tabular data do not allow us to choose 0.22 as the step- 
size, wo take the closest possible number, 0.2, as h,. Consequently, 


hoi = = 0,4 when calculating /' (1.6) 


hoz = œ 0,22 when calculating /” (1.4). 


ra= 5 (3.4710 — 4. 0,4154 40.3364) == 0.624, 


the total error not exceeding 





20.73 poy 4107 yy 
А= —5- 0.1? - от ^^ 7. 
and I" (1.4)= 19 ,4700 — 2 .1,3364 + 9.1823) = — 9.512, 
the total error. not exceeding 
2.9 4.1071 
== 221% (920 T 14.02, 
а= т == 


Although the estimates of the error are as a rule, too high, still it 
shows that the operation of finding the second derivative is more 
reliable than that'of finding the lirst derivative. A 

In some practical cases we have to find the derivative 
being given опу a table of values of the function. Then 
it is evidently impossible to evaluate the error. We cal- 
culate the approximate values of the derivatives directly 
from one of the formulas (4)-(13) from 8.1, disregarding 
the error. 


Example 2. Calculate /' (1.3), /" (1.4) for the function / (z) 
given as a table 


т | 1.2 | 1.3 | 1.4 | 1.5 | 1.6 


y=t(z) | 0.18 | о | ом | ом | 0.47 


A From formulas (4) and (6) given in 8.1 we obtain, respec- 
tively, 


r (1.3) = . + (0.34 — 0.26 + 0.26 — 0.18) -=0.8, 


r (14-5 (0.41 —0,34 —0.34-+0.26)= —1, А 
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8.3. Statement of a Problem of Numerical Integration 


Assume that we have to calculate the integral 
b 


I= | f (2) da. (4) 


а 


We know from analysis that for the function f continuous 
on the interval [a, 5] integral (1) exists and is equal to the 
difference of the values of the antiderivative / of the func- 
tion f at the points b and a: 


b 
1- | f (z) dz == F (b) — F (a). (2) 


a 


However, in the majority of practical problems it is 
impossible to express the antiderivative in terms of ele- 
mentary functions. In addition, the function f is often 
given as a table of its values for definite values of the 
argument. All this makes it necessary to use approximate 
methods of calculation of integral (1) which can be con- 
ventionally divided into analytical and numerical 
methods. The former consist, in essence, in the construc- 
tion of an antiderivative and further use of formula (2). 
As to the latter, they make it possible to find the nu- 
merical value of the integral from the known values of 
the integrand function (and sometimes of its derivatives) 
at given points known as nodes. In this chapter we con- 
sider only numerical methods of integrating a function. 
The process of numerical calculation of an integral is 
known as quadrature and the corresponding formulas as 
quadrature formulas. 

Depending on the method of definition of an integrand 
function, we shall consider two distinct, in the sense of 
their realization, cases of numerical integration. 

Problem I. The values /; of a function / which belongs 
to a definite class F are given on the interval (а, 5] at 
the nodes z;. We have to approximate integral (1) and es- 
timate the error of the value obtained. 

This is the usual statement of the problem of numerical 
integration when the integrand functio: is given as а 
table, 
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Problem 11. On the interval |а, b] the function f(r) 
is given in tlie form of an analytical expression. We 
have to calculate integral (1) with a specified limiting 
СГГОГ E. 

: One of.the possible methods of solving Ше problems 
stated is based on tlie use of various quadrature formulas 
of the form 


= [rosato 5 алт, (3) 


іші 


with the known remainder /?„ [f| = I — /, or Ив esti- 
inate. 

In the general case the nodes w; and Lhe weight factors 
(weights) A; are not known in advance and must be found 
when each quadrature formula (3) is derived, on the basis 
of the requirements imposed on it. 

In essence, the problem of numerical integration is 
equivalent to the estimation of the mean value of a 
function. Indeed, the mean value of a function on the 
interval (а, b] is delermined as follows: 


0 


2 ШЕ dz 


a 





> 4 
[= = 


and therefore 
b 


f f (a) dz — (b — ау]. 


а 


In its turn, the calculation of the mean value оѓ а func- 
tien is a'statistical problem which includes the problems 
of successive sampling and planning an experiment. Sinco 
it is difficult. to pose such a problem, we shall consider 
in ‘this’ chapter only clássiea! methods of numerica! in- 
tegration based on the preliminary definition of the 
nodes ‘at which the information on ‘the function being 
integrated must be given and of the information itself, 
 We' pa$8s now ‘to the algorithms of the solution of the 
problems formulated above. | i (s 

Algorithm of solution of Problem 1. 0 3 
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19, We choose a definite quadrature formula (3) and 
calculate £,. If the values f; of the function are approxi- 
mate, then we calculate, iu fact, only the approximate 
value Г, for the exact value 7,.- 

2°, We assume approximately that I = Ty. 

3°. Using a definite expression for the remainder or 
ils estimale for the chosen quadrature formula, we cal- 
culale Lhe error of the method: 


A= |I ~Ia >| Ra 


4°, We calculate the computing error Г: 
Аҙ = | I, — Г, | 


using the errors of the approximate values fi. 
59. We find the total absolute error of the approximate 
value Zp. 


А-|1-Т, KA А, 
69, We obtain the solution of the problem in the form 
Io. А. 


Vor sufficiently smooth functions, i.e. for functions 
with a limited variation of the derivatives, the error of 
the quadrature formulas (3), for sufliciently large n, is 
small as a rule. Therefore, if the initial values f; and 
the calculations of 1, are sufficiently accurate, we can 
expect that J, will be a close approximation of 1. These 
considerations serve as the basis for the followin; al- 
gorithm, 

Algorithm of solution of Problem I. 

19. We represent в as the sum of three nonregative 
terms: 

€ = E; 4- Е, + £a 


where e, is the limiting error of the method, ex is the lim- 
iting error of computation of Jn, £4 is the limiting 
error of rounding off the result. 
2°. We choose n in the quadrature formula such that 
the inequality 
A =] —1„|— || oe 


is satished. 
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3°. We calculate f; with an accuracy which would en- 
sure the validity of the inequality 


А, = ІІ, —T, I< еҙ 


when 7, is calculated from formula (3). To do this, it is 
evidently sufficient to calculate all f; with the absolute 


e 
error 


- . 
(b—a) Х [411 
ізгі 


4% We round off the value of 1, found in item 37 (if 


£4 0) with the limiting error е; tothe value 7,. 
5°. We obtain the solution of the problem in the form 


1= Г, +e. 


As we have mentioned, the quadrature formulas used 
in the algorithms of the two problems are constructed 
on the basis of some criteria defining the position of the 
nodes and the values of the weight factors. Here are some 
of the criteria that may be used: representation of an 
integral as an integral sum, approximation of an inte- 
grand function (say, by a polynomial) followed by the 
integration of the approximating function, the requirc- 
ment that formula (3) should be absolutely exact for 
a definite class of functions, and others. 


8.4. Basic Quadrature Formulas 


Rectangular formulas. As is known, by virtue of its 
construction the definite integral is the limit of integral 


sums 
b n 


[/(dz— Ша 20/8), (t) 


A max һ,-0 ісі 


each of which corresponds to а certain division D,: 
a=2,<24,<....<2, =b of the interval |а, 6] 
and to the arbitrary collection of points E, € [z;.,, ril 
for each division, №, = T; — zi ,. 

Restricting our consideration to a finite number of terms 
on the right-hand side of relation (1) and taking particu- 
lar values of the argument belonging to the interval [z;-,, 
zj] as a collection of points E;, we can get various formulas 
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for approximate integration. Thus, taking the values of 
the left-hand and right-hand endpoints of the interval 
[,-,, zıl as Ej, we get a formula of the left or right rectan- 
gles respectively (h; = 1/n =- const): 


5 
АСТЕ ЕРЕ fm (2) 
М 
ге {пваа X mL (3) 
а іс-і 


The names of these formulas are due to their реотеігі- 
cal interpretation. lf we construct a curve y = f (x) іп 


y 


y=f(x) 4 





Fig. 8.2 


the zy-plane and divide the interval |а, b] into n parts 
by the points т; of the net D,, then the formula of the 
left rectangles yields, as an approximate value of the 
integral, the total area of the hatched rectangles shown 
in Fig. 8.4 and the formula of the right rectangles yields 
the total area of the hatched rectangles shown in Fig. 8.2. 
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Example 1. Using the formulas of the left and right rectangles, 


9 
dz 
calculate | т? 
1 
4^. Knowing the integration limits a := 1 and b = 9, we find 
the step h = (b — a)/n = 2. Then z, = 1, т) — 8,2, = 5,2, = 7 
and т, = 9 are the division points and the values of the integrand 
function f (г) = 1/(z -|- 2) at these points are 


Yo = ) (Xp) = 1/3, Yy = Í (zi) = 1/5, 
Yo = Í (тә) = 1/7, узг f (23) = 1/9, Ja = f (24) = 1/11. 
Next we find the numerical value of tho integral using formula (2): 


(Yot 91 - Ja-- Yo) = 2 (CT Fx) e 1.6024. 





setting п--4. 


b—a 
n 





h= 


Now if we use formula (3) to calculate the definite integral, thon 
we obtain 


b— 4 1 1 1 


кз nca =2 (56 е tir) #1153. А 





The rectangular formula, where the midpoints of the 
intervals [r; ,, т} are taken as Ё;, is the most widely used 
formula based on ihe representation of a definite integral 
as an integral sum. For a uniform nel (A; = А) this for- 
mula has the form 


b n 


b— J 
1 == | Қа) йт = 2 > fian = Tn (4) 
а 1-1 


n 4 
h 


where fiaz — f (s—5) , туса, 2-0. 


We seek an expression for the remainder of the approx- 
imate formula (4). For our purpose, we represent the 
integral appearing on the left-hand side of relation (4) 
as а sum 





b n "ij 
ІШЕ dz= >) | f(x) dz. (5) 
а іэгіх;і 


Assuming the function f (г) to be twice differentiable, 
i.e. f € C? [a, b), we write, for the function f (ғ), on each 
of the intervals [z,-,, т], Taylor's formula with the 
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remainder in Lagrange's form: 


h (722) 
f (2) = fius (2—2, +3) fi-1p2-+——3—_ f (п), 


т C (zia, т). (6) 


Replacing the function f on the right-hand side of relation 
(5) by its representation (6), we carry out the inlegration 
using the second theorem of the mean: 

b 1 ть һз т 
\ da - 06 —2) 4-2) fous У) f 0), 


a 1—4 іші 
Ti € (2:4, ту). 


Since the second derivative is continuous, there is a 
point n € (a, 0) such that 


- " fun ” b— " 
2 бт) == п/" (т) = Rf" (т). 
jest 
Using this relation, we ПтаПу obtain 
b n 
1 b— , 
| 16) 4-0-9) D x fiant Rm. (7) 
а i=1 
Comparing formulas (4) and (7), we get an expression for 
the remainder in the quadrature formula (4): 
b—a jog 
В — L— I, =P (n). (8) 


We can thus represent the estimate of the erro. of the 
quadrature formula (4) in the form 





«LEM. (9) 


b n 
л,= | (706) 4-0-9 2 Ita 
а 4-і 





where M, == max |)” (z)|. 


'The expressions for the remainder (8) and for the error 
(9) show that formula (2) is exact for апу linear function 
since the second derivative of such a function is zero and, 
consequently, the remainder and the error are zero too. 


26—0104 
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We shall prove that the estimate obtained cannot be 
improved, i.e. that there is a function for which the error 
of computing an integral from formula (4) is exactly equal 
to the right-hand side of (9). For this purpose, we shall 
consider f — т? as the function being integrated and apply 
formula (4) to it: 


1,—6—2)4- X (a+ 2-1 A). 
=! 





Removing the brackets under the sign of the sum and 
carrying out the summation, we obtain 
b3 — a? 
3 





2 
І, = -(%-а)-%. 


On the other hand, a direct integration of the function 
z? yields 
b 
1—||zdrm 


a 


b3 — аз 
3 . 





Setting up a difference of the exact value of the integral 
and its approximate value, we get the following expres- 
siou for the remainder: 


h2 
1—1, = (0— а) ж. 

Returning to the estimate of error (9) and noting that 
for the function 7? the second derivative (and, conse- 
quently, M,) is equal to 2, wo get the same value for the 
error 


2 
Ay=(b—a) t 


i.e. the estimate of error (9) is attained on the parabola 
y — 17. This result can be extended to an arbitrary pa- 
rabola since the operation of integration is linear and 
formula (2) is exact for linear functions. 

Estimate (9) evidently does not take into account the 
errors of the calculation of Г,. The error A, reflects the 
difference between the exact formula of Newton-Leibniz 
and the approximate formula (4), i.e. is an error of the 
method. ` 
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Let us now estimate tho error of the approximate value 


In- If the values of the function used in the quadrature 
formula have been obtained by an approximate method 
or, for some reason, the calculations cannot be absolute- 
ly accurate, then a computing error and rounding cr- 
rors occur. Assume, for instance, that the values f, /; 
in formula (4) have been calculated with the same abso- 


lute error e. Then the total computing error 1, constitutes 


da= (b—a) 2; +e- (b—a)e. (10) 


i=1 


Note a characleristic peculiarity of this error: it does 
nol depend on the number of divisions of the integration 
interval but is only proportional to its length. 

1 


Example 2. Uso the rectangular formula to calculate | T 
% 
selling n — 4. Estimate the orror of the approximate value ob- 
tained. 
А From the given integration limits and tho number of divi- 
sions n wo find tho step: | -- (1 — 0)/4 = 0.25. Next, from formu- 
la (4) we get 


ep) er) (01. 


Calculating tho necessary values of the function with three valid, 
in the narrow sense, digits (в == 0.0005), we obtain 





1 
| тз" (0.889 1-0.727-1-0.615-{- 0.533) = 0.091. 
0 


We use formula (9) to estimate the error of the method, for which 
purpose we first find the maximum of the absolute value of the 
second derivative of the integrand function: 

М, == max 


1 n 
(0, 1] (==) 
Thus the error of the method is 
A, « (1/24). 0.252. 2 œ 0.0053. 
Using formula (10), we find the computing error 
A, < 1.0.0005 = 0.0005, 


= max 2—2 
"та te 
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Consequently, we can take A = A, + A, = 0.006 as the total 
error of the approximate value of the integral and write the final 


б dz 
answer | TH: = 0,691 + 0.006. 
0 


For the sake of comparison we give several digits of the exact 
value of the integral calculated: In 2 = 0.693147... . 5 
ihe inte- 


Example 3. Use the rectangular formula to calculate 
1 


dz : 
gral | ite with an accuracy of 0.004. 


0 


A Applying the algorithm of the solution of Problem II from 8.3, 
we represent the total error as the sum of three terms: 0.004 = 
0.0009 + 0.00005 4- 0.00005. Next we choose n from the con- 
dition 

b—a 
A= ogy Ma 





b—a (2 
24 
Solving this inequality with respect to n, for b — a — 1 and 
M, = 2, we get n> 10. 
We tabulate the values of the function 1/(z + 1) with [our 
valid digits in the narrow sense: 


0.45 | 0.15 | 0.25 | 0.35 | 0.45 | 0.55 | 0.65 | 0.75 | 0.85 | 0.95 


2 
) Ma < 0.0009. 


1.9254 (0. 8696|0 „Воо . 7407o 6897.645210 .6o64]o 57140 .5405]0.5128 


Using the rectangular formula (4), we obtain 
Те = 0.1 (0.9524 + 0.8696 + 0.8000 + 0.7407 + 0.6897 +0.6452 
+ 0.6061 + 0.5714-+-0.5405--0.5128) =0.69284. 
Rounding off the result obtained, we have J = 0.6928 + 0.001. A 


The trapezoid formula. Let us consider now another 
method of constructing quadrature formulas connected 
with the approximation of an integrand function by an 
interpolating polynomial. We consider a simple case 
of approximation by a first-order polynomial with nodes 
at the points а and b: 


f (2) =f (a) + Z5 ү} )—F(@)) (6—0) s —) LO, 


n€ (a, b). 


Integrajing the right-hand and left-hand sides of this 
relation and employing the second theorem of the mean 
to integrate the last term on the right-hand side, we 
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obtain 


e 





b 
| /@ав= ^g U () - f (0) — 5 f (9), пє(а, 9. 


Thus, assuming that the interval of integration is small, 
we gel a quadrature formula known as the trapezoid 
formula: 

b 


1- Қойға Frist, (11) 


a 





with a remainder 


R, [f] = I—l,— (b --a)? 


-LE m, nela 0). (12) 


Using expression (12) for the remainder, we can represent 
the estimate of the error of the quadrature formula (11) as 


< ze 





b 
л, оаа ^ 7* d 0)4.0)|« M, (13) 


where Af, =: max |f" (x)|. 
[а, Б] 


The expressions obtained for remainder (12) and error 
(13) show that the quadrature formula (11) is exact for 
all linear functions since the second derivative of func- 
tions of this kind is zero and, consequently, the remainder 
and the error are also zero. 

By analogy with what we have done for estimate (9), 
we can show that estimate (13) cannot be improved 
since it is altained on an arbitrary parabola. 

When formula (11) is used to estimate the computing 
error for the case, when the values of the function have 
been caleulated with the same accuracy e, the estimate 
has the form 





2. (e 4: к) = (b — a) e. (14) 


Ас” 


Note that the computing errors of the quadrature for- 
mulas (11) and (4) are the same. 


Example 4. Use the trapezoid formula to c^lculate the integral 
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1 
| LI Estimate the error of the approximulo valuo obtained. 


A From formula (11) we havo 
I, = 0.5 [f (0) + / (1)]. 
Calculating the required values of the function, we get 
қ d 
r n 
| Tpz" (1--0.5) = 0,75. 
0 


W^ find the error of the method from formula (13) using the 
value M = 2 obtained in ample 2: 





The computing crror is evidently zero since Lhe values of the 
function and J, have been found with tho absolute accuracy. 
1 


Thus the fina] result is Е с == 00.75 0.17. A 


+= 


Note that. in Example 4 we had a considerably less 
accurate solution than in Example 2. However, we inust 
not draw a hasty conclusion since the use of the trape- 
zoid formula in Example 4 has some advantages. First, 
whereas the integrand function is given in the form of 
a table of its values at the nodes z;, the use of the rec- 
tangular formula requires that the values of the function 
should be also found at the points г; + h/2, and this 
involves additional difficulties and errors. Second, in 
Example 4 the values of the integrand function were 
calculated at two points whereas in Example 2 this was 
done at four points, which naturally took more time. 

These arguments show that the importance of the 
quadrature formula is defined not only by the form of its 
remainder (the error) but also by other factors, the time 
taken by calculations, for опе. 

Other kinds of the quadrature formula. Let us consider 
one more way of constructing quadrature formulas, that 
of representing the integral as a linear combination of 
the values of the integrand function and its derivatives 
at some nodes т, followed by determination of the un- 
known coeflicients (weight factors). 
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Assume, for instance, that we are constructing a quad- 
rature formula of the following kind: 


b 


| f (т) dz = (b — a) [ A,f (a) + Aaf (b) + АР (a) + 4,7 (0)1. 


a 


(15) 


We find the weight factors A, (i = 1, 2, 3, 4) such that 
forinula (15) is exact for arbitrary polynomials of degree 
zero, one, two and three. Since the operations of integra- 
tion and differentiation are linear, this condition is ful- 
filled if it is fulfilled for the polynomials 1, z, z? and 13, 

Substiltuling these polynomials for f(z) in relation 
(45), under the condition of its exact validity, we ob- 
tain the following system of linear equations for А;: 


A, + A, == 1, 
aA, БА, + A+ А, = (00), 
| 2А, 0А, + 20А; 20А, + (a? -|- ab -|- 6), 





aA, -} BA, Заз -H 302A, = - (a3 + азр + ab? + b°). 
Solving this system, we lind that 
A, = A, = 1/2, A, = —A, = (b — а)/12. 


Thus the required quadrature formula has the form 


b 
1= { f (z) dz = (b~ a) ©. 


a 


+ (b — a) FOTO) = [,. (16) 


We seek ап expression for the remainder of this for- 
mula, for which purpose we represent the function being 
integrated as the sum of a third-degree Hermite interpo- 
lating polynomial with two double nodes a and b and the 
reinainder and then integrate the right-hand and left- 
hand sides of that representation on tho interval [а, b]: 
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b b b 
| л) а= | нае | SE лу @ da, 


"€ (a, 5). 


The first term on the right-hand side yields tho right- 
hand side of the quadrature formula (16) since this for- 
mula is accurate for all third-degree polynomials and, 
consequently, for the Hermite polynomial H, (т) as well. 
The second term on the right-hand side yields an ex- 
pression for the remainder of formula (16). Using the 
second mean-value theorem and carrying out the in- 
tegration, we obtain 


R, [f - 1— I, = eet 


mF), nele b). (17) 


The expression for the remainder we have obtained 
makes it possible to write the estimate of the error of the 
quadrature formula (16) in the form 


A= 1111-09 


aay Ма (18) 
where M, = imax |f!" (z)|. 


a,b 
Estimate (18) cannot be improved since it is altained 
on an arbitrary fourth-degree polynomial. It is easy to 
prove this by analogy with what we have done for esti- 
mate (9). | 
To estimate the computing error of {һе result, obtained 
from formula, (16), we assume that the values of the 
function are specified with an accuracy of е) and the 
values of the derivatives wilh an accuracy of &,. Then 
the computing error is 
(в--а)? 


A,« (b — a) & + 7—g Er 49) 


Example 5. Use the quadrature formula (16) to calculate the 
1 


integral | . Evaluate the error of the approximate value 


dz 
t-z 
obtained. 

A Calculating the required values of tho integrand function 
and its derivatives with the use of formula (16), we find that 


a [0:5 14 —110.25) suus 
1-1 (4 tS) = 0.0875. 
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We use formula (18) to evaluate the error of the method, for 
which purpose we first find the maximum of the absolute value of 
tho fourth derivative of the integrand function M, = 24: 


15 
A1 x zi 74 = 0.034. 


The computing error is evidently zero since the values of the func- 
tion and those of the derivatives have been calculated with the abso- 
lute accuracy. 

Thus, rounding off the approximate values of the integral and 


1 
А А ах 
(^ n » : 2 LÁ zc X 4 
the error, we finally obtain ІН Tz 0.69 + 0.04. А 
0 


Up till now, iu all the quadrature formulas we have 
considered, the quadrature nodes were fixed. We shall 
now consider the case when the position of all the nodes 
as well as all the weight factors are assumed to be free 
parameters. For the computations nol to be very com- 
plicated but at the same time nol trivial, we shall seek 
the value ^f iue integral in the form 


b 


} ле) ас b= a LA EA As шы. (0) 


“ 


То determine the four free parameters Ау, Aa, xr, and 
ғ» we require that formula (20) should be absolutely 
accurate for all polynomials of degree zero, one, two 
and three. By virtue of linearity of the operation of in- 
tegration and the right-hand side of relation (20), for 
the quadrature formula (20) to be exact for all. Unird- 
degree polynomials, it is necessary and sufficient. that 
it be exact for the functions 1, г, х2 and <”. Consequently, 
there must hold relations 


1 A, -- 4, = 1, 
"mn T ыл» -- 5 (а -H b), 
ly | tly = (a? +- ab 1-1), 


Ey Ay d wy = + (a3 4- a?b + ab? + 02), 
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which constitute a nonlinear system of equations with 
respect to tho parameters 7), z,, A, and A, being de- 
termined. 

The solution of this system is 


1 
„bta 5-а 1 __ b+a b—a 1 
^T. —:3 Uyp'| 7: 0 3 yg: 
(21) 


Thus the quadrature formula (20) assumes the form 
b 


= f(z) dz = 2° [7 ( ote ват. 














) 2 2 y3 
HE (9344734 2) Jan (22) 


Formulas of the kind when not only weight factors 
but also nodal points are not fixed in advance are known 
as Gaussian formulas. 

We seek’ an expression for the remainder of formula 
(22). For this purpose we represent the function being 
integrated as the sum of a third-degree Hormite inter- 
polating polynomial with two double nodes т, and z,, 
defined by relations (21), and the remainder. Integrating 
ihe right-hand and left-hand sides of this representation 
on the interval [a, b], we obtain 


b ^ b b 
| ле) ds f H(z) dz ЕЕ ІСІН 
"€ (a, b). 


The first term on the right-hand side yields the right- 
hand side of the quadrature formula (22) since this 
formula is exact for all third-degree polynomials and, 
consequently, for H, (с) as well. The second term оп 
the right-hand side yields the remainder of formula 
(22). Using the second theorem of the mean and car- 
rying out the integration, we have 


R,fj21—1,— 0)" Р. (y), "С(а, b). (23) 
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Consequently, the estimate of the error is expressed by 
ihe relation 
b— a)? « 
МеШ-і- Mo (24) 
where M, = max |f! (z)]. 
[а, 5] 

The estimate obtained cannot be improved since it 
is attained on an arbitrary fourth-degree polynomial. We 
can easily show this by means of direct computations as 
we did for estimate (9). 

If the values of the nodes in formula (22) are practically 
exact and the values of the function have been found 
with an absolute error в, then we shall get the same ex- 
pression for the computing error with tlie use of formula 


(2) as for the computing error with the use of formulas 
(4) and (11): 
Ags (b — a) е. (25) 
Example 6. Use the quadrature formula (22) to calculate the 
! 
integral | es Evaluate the error of the approximate value 
obtained. 
A First of all we find the nodes of the quadrature formula: 





1 1 
Ll 9413246 
2,—5 (1 уЗ 1.2113249 ..., 


1 1 
nes (tv) —0.7886754 . 
Having calculated the required values of the integrand function 
with an accuracy to within three valid digits in the narrow sense, 
we use formula (22): 


| 27 4 (0.826 4.0.59) = 0.6925. 


We find the error of tho method from formula (24), for which pur- 
pose we use the value of tho maximum of the absolute value of the 
derivative M4 — 24 found in Example 3: 


5 
A< i = 0.0056, 
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We can find the computing error from formula (24) taking into 
account that the accuracy of the calculation of the values of the 
function being integrated is equal to 0.0005. 

Thus the total error is A = A, + A, = 0.0061. 
Finally, rounding off the approximate value of the integral, 


| dz 
we have f Tga 70:692 + 0.007. A 
0 


The main purpose of this section is to show by simple 
examples how to derive various formulas of numerical 
interration. We have not naturally considered all the 
metiiods of constructing formulas. АП the same, the 
examples given are typical so that using them, the stu- 
dent can construct a specific quadrature formula which 
suits best of all the practical problem posed. 


8,5. Newton-Cotes Quadrature Formulas 


In this section we discuss formulas of numerical inte- 
gration which are more complicated in structure. Up till 
now we considered interpolation methods of numerical 
integration including, in a definite sense, the rectangular 
formula. This means that the integrand function was ap- 
proximated by an interpolating polynomial. If the func- 
tion being integrated is smooth enough and the interval 
of integration is finite, we can gel sufficiently good 
results. On the other hand, it is hardly possible to at- 
tain a close -approximation of a function by a polynomi- 
al if the function itself or its derivatives of low orders 
have peculiarities. In such cases it is expedient to re- 
present the integrand function as the product of two 
factors р (2) f (г), which must possess the following 
three properties. First, the weight factor p (г) must reflect 
all the peculiarities of the function being integrated and, 
second, the moments 

b 
My = ( p(z)z*dz (k-=0, 4, ...), (1) 
а 
where (а, b] is an integration interval, must be calculated 


by analytical methods. Third, the error of approximation 
of the function f (z) by a polynomial must be smal]. 
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Let us now construct the quadrature formulas them- 
selves. We shall construct them in the same form as before: 
b 


Іт | р (а) f(a) dz = (0а) У л/а). Q) 

а t=1 
In the general case, as we mentioned before, formula (2) 
has 2n free parameters which are the quadrature nodes 
х; and the weight factors A; We assume the number п 
to be fixed. The choice of free parameters is defined by 
the same requirements that are imposed upon а quadra- 
ture formula by the conditions of a practical problem. 
These requirements may be, for instance, the maximum 
possible accuracy, the minimum computing error, the 
lixing of some (and, maybe, all) weight factors or quadra- 
ture nodes. 

We begin with a relatively simple case when the nodes 
are specified in advance and we can vary only the choice 
of the weight 1actors А). The idea of interpolating quadra- 
Lures is lhat we approximate the function f by an inter- 
polating polynomial in Lagrange's form of degree n — 1 
using n different nodes д: 


Í (г) = La (г) 4- Haa (z), 
integrate the right-hand and left-hand sides of this re- 


lation on the interval |а, b] first multiplying them by the 
weight function p (г): 


b b b 
| о@)/@)а= | p(x) Lia (а) dat | р (2) Ry G) dz, (3) 


and transform the first term on the right-hand side of this 

relation, for which purpose we replace Lp by its explicit 

expression and interchange the operations of integration 

and summation: 
b 


| p@ 702) 4 


b 


(Vei ae! ar) л. (4) 


(2—11) 05, (2) 


M: 


= 
| 


1 


Here в, (2) = ДІК (г--2,). The first factor under the 


sign of the sum is numerical coefficient which is pro- 
portional to the length of the integration interval and 
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depends only on the position of the nodes and the prop- 
erties of the function p (г) (but not on the function f). 

Assuming now that the second term on the right-hand 
side of relation (3) is small, we get the approximate quad- 
rature formula (2) with the specified nodes т, and coef- 
ficients A, defined as follows: 


b 
4 - , 
4, =u \ 0 (г) [EET MUT (т) ат (i= 1, 2, ...) п). (5) 
а 


Тһе quadrature formula (2) thus constructed is known 
as an interpolation formula. 

Let us now estimate the error of formula (2) with coef- 
ficients (5). To do this, we integrate the remainder of the 


interpolation formula R,_, (х) — nari f (n). Sub- 


stituting this expression for #,_, (г) into the second term 
of relation (3), we obtain 


. b 
Roall 1 Т = | р (2) ө, (2) f (п) dz, TE (a, 9). 


a 


If the function / has a continuous derivative of order 
n on the interval of integration and the product 
p (т) өп (т) retains sign on this interval, then we can 
get the following expression for the remainder: 


b 
валы EE È piona) dr, nel 0, (6) 


a 
and, consequently, the estimate of the error of the quad- 
rature assumes the form 
b 


| 0 (2) Ons (ж) dz], (7) 


а 


where M, = max |f? (z)). Under the conditions indi- 
a, b 


M 
AS aT 





cated above this estimate is the best. 2, 
Now if the product p (т) ©n-ı (т) does not retain sign 
on the integration interval, then we get only a rough 
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b 
estimate of the error Ay< A [р (2) o4, (2) | dz, 
а 


which may turn out to be far from the optimal one. There- 
fore, in such cases other reasons are taken into con- 
sideration when an explicit expression is constructed for 
the remainder and the error. We shall discuss one of these 
techniques later on when we study Simpson's rule. 


Example 1. Construct the quadrature formula (2) for the inter- 
val [— 1, 1] with nodes т = — 1, z, = 0, ту = 1 and a weight 
function p (z) = (1 — z?) 177. 

A In essence, we have to determine the coefficients A; (i = 
2, 3) appearing in formula (2). Using expression (5) for the it red 
coefficients, we have 


E (2—0) (z—1) dz _ 
NN i-o(-i-)' "Vion &' 


(z4- 1) (2—1) dz 2A 
з= |4 ODO y1i-s 2” 


2A,— | (z-|- 1) (= — 0) dz л 


CFD Tay уута A 


Thus the required formula has the form 
1 


|i 


-1 


Example 2. Construct the quadrature formula (2) for the .nter- 
val [0, 1] with nodes т, = 0, г, =: 0.5, 7, = 4 and weight function 
р (2) — In =. 

A Аз in the preceding example, we uso formula (5) to find the 
coefficients: 


AC 1-2/ (00-F 100]. A 





(z —0.5) (z — 1) d 11 


In = M — 9) — а. _ 


(0—0.5)(0—1) 45-36” 


| 
A= 
0 
1 
(2—0) (2—4) 20 
А- =È neg ap = 3 
А 
«-| 


(z — 0) (г--0.5) 


1 
In 2 4—10)4—05) 97 = 36 
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Thus 
1 


[ша f(x) dz =E (174 0)4-29/ (0.5) — D. А 
ò 


Note the characteristic features of the examples consid- 
ered. In Example 1 the symmetry of the nodes and the 
evenness of the weight function with respect to the mid- 
point of the interval led to the symmetry of the cocf- 
ficients of the quadrature formula. In Example 2, despite 
the symmetry of the nodes, the symmetry of the coef- 
ficients is violated, which is the consequence of the 
absence of symmetry (evenness) of the weight function. 

In practical computations of especial interest is the 
case when the nodes of the quadrature formula are given 
as equispaced points of the interval [a, б: =; — 
a -(íi —1) h (i—1, 2,.... n) and the weight 
function p (z) is identically equal to unity. On these 
assumplions we can transform formula (2) as follows: 


b 
|а )4т e (b—a) 2 Hif, (8) 


i=1 


For different n we get different quadrature formulas of 
Newton-Cotes. The coefficients H; known as Cotes’ coeffi- 
cients can he found from relation (5): 


n 


л С i40» 
Н аус сет | ) рр o dh 
n>1, i=1, 2,...,m; 01-1. (9) 


These coefficients possess the following properties useful 
for calculations. 
19. The symmetrical coefficients (the first and the nth, 
the second and the (n — 1) th, . . .) are equal to one another: 
H, = Н nti-i 


П We replace i in expression (9) by n 4-1 — i: 


_ (—1)1 (0—0)... @—n) 
Hsu = Goo A t—n—1+i dr. 
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Passing to a new variable q = n 4-14 — t under the in- 
tegral sign and carrying oul. simple transformations, we 
obtain 


т 
__ (-1)л-і (q —n) ... (4—1) 
Hai == Goh (лю i \ 4-і 44, 
and this coincides with expression (9) for the coefficients 
H,. 

29. The sum of all the coefficients is equal to unity: 


12 
кь 


Нұ- 
4 


| 
ҺА 


O The validity of this property follows immediately 
from formula (8) if we set f (т) -- 1 since the remainder 
of this formula, delined by expression (6), is zero for 
/ (т) --1. Ш 

Table 8.1 gives the values of Cotes’ coefficients for 
n zz 2, 3, 4, 5, б. 


Table 8.1 





n 


2 1/2 1/2 

3 1/6 4/6 1/6 

4 1/8 3/8 8/8 1/8 

5 7/90 | 32/90 |12/9 | 32/90 | 7/90 

б 19/288 | 75/288 | 50/288 | 50/288 | 75/288 | 19/288 





We shall consider in more detail а significant special 
case of the quadrature formula (8) resulting at n = 3. 
То construct this formula, we could use the data from 
Table 8.1 but we shall perform the requisite calculations 
by way of an example. Employing formula (9), we obtain 

C- 1)? à 1 
H, = A -\ (¢ — 2) (2—3) dé ---. 





26-0104 
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Next, using relation (10), we find that 
Hy, = Н, = 4/6, Н, =1 — (I, |- Ну) = 2/3. 


Thus the required quadrature formula, known аз 
Simpson's formula, has the form 








b 
T= | f(z)dz 04 [ f (a)-+ 4f ( е +O |і. 
| (11) 


Ву virtue of its construction (approximation of the 
integrand by a second-degree polynomial), this formula 
is exact for all polynomials of degree zero, one and two. 
We could try to obtain an expression for the remainder 
directly from relation (6). However, Simpson's formula 
possesses the so-called property of increased accuracy 
meaning that it is exact not only for second-degree poly- 
nomials but also for third-degree polynomials. Since 
the operation of integration is linear, it is sufficient to 
establish an exact equality of the right-hand and left- 
hand sides of formula (11) for the simplest third-degree 
polynomial z? in order to prove this statement. Indeed, 
calculating the left-hand side of formula (11) for / = 19, 


we have 
b м 
—gi 
) 13 dt = 


4 е 





а 


On the other hand, calculating the right-hand side of 
formula (11), we obtain 


T d 


and this is what we wished to prove. 

We shall take advantage of the statement we have 
proved to construct the remainder of Simpson's formula. 
We represent the function f as the sum of Mermite’s in- 
terpolating polynomial with simple nodes a and ^, a 
double node (a + b)/2 and a remainder 





f (х) =H, (x) + (x — a) (z — «ыт ae) ВЫТ , 
n€ (a, b). 
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We integrato the right-hand and left-hand. sides of this 
relalion on the interval fa, ^5]. By virtue of what we 
have just proved, the integral of Ilermite’s polynomial 
yields the right-hand side of formula (11) and the іпіс- 
рта! of the second term yields its remainder 


RIN Ty SS f (n. ne (a, D). (12) 


Consequently, we can represent the estimale of the error аз 


b — a)5 
ASI- hE M, (13) 
where M, == max | ЛУ (г) |. This estimale cannot be 
a,b] 


improved since it is attained, say, for the function f = г. 


Example 3. Use Simpson's rule to calculate the integral 





1-|-т 
) 
A Calculating the needed values of the integrand at the points 
xz, = 0, т, = 0.5, ту = 1, we substitute them into formula (11): 


1 
| dz . Estimate the error of the approximate value obtained. 
( 


I= 1 (1--4-0,067--0,5) = 0.6947. 


ІУ 
Taking into account that M,.-- max | (ci) |- 24 and using 
[0, 1] Y 
formula (13), we find that the error of the method A, < 0.0034. 
Let us find the computing error: 


As < £ (0 H-4-0.0005 4-0) = 0.00034. 


Adding the errors together and rounding off the result, we oir.ain 
1 





dz ( 
| 112 0.695 4- 0.04. A 
0 

The property of increased accuracy described above is inherent 
in all quadrature formulas of type (8) constructed with the use of 
an odd number of nodes. This property is a direct consequence of 
the “symmetry” of the quadrature, i.c. the equality of the symmetric 
coeffücients H; = H,,, ;, and the linearity of the operation of 
compuling the value of a function and that of integration. To 
obtain a precise estimate of the remainder of such a formula, it is 
necessary to approximate the integrand by Hermite's interpolating 
polynomial with a double central node. 

Returning to the quadrature formula (2), wo can state that 
when the coefficients are symmetrical (A; = 4,,,.;) and the weight 
function is even, this quadrature constructed with the use of 2k -|- 1 


26% 
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nodes is exact for all polynomials of degree 2k + 1 since it is exact 
for any function / which is odd with respect to the midpoint of the 
b 


interval of integration. Indeed, on the one hand, | p (г) f (г) dz = 


а 
2h41 
0 for functions of this kind, and, on the other hand, > А), = 0 
1 


=] 
by virtue of the symmetry of A; and the oddness of /. 
Example 4. Using the quadrature formula constructed іп 


1 
Example 4, calculate the integral | one dz and estimate the 
11 


Vi-z 
error. 


A We calculate the needed values of the function / = cos z: 
cos (—1) — 0.540, cos 0 -= 1, cos 1 = 0.540. Substituting these 
values into the quadrature formula, we have 


1 


cos z dr x = (0.540 + 2-1 +-0,540) = 2,419, 


А Vi—z 


We seek now an expression for the remainder of the quadrature 
formula given in Example 1, Since the weight function is even and 
the nodes are symmetric and odd in number, this formula possesses 
the property of increased accuracy, i.e. it is exact for all third- 
degree polynomials. Therefore, by analogy with what wo did for 
Simpson's formula, we use Hermite's interpolating polynomial with 
a double central node z, = 0 and get the following expression 
for the remainder: 

1 
PY (m ( (24-1) 29 (2—1) л AV (ту; 
һр | ТЫН aso gl" (лу; 0-4,0) 








i 
Consequently, the error of the method is 


AL S max |созт|-- 0.047. 


A 
192 p^, 4] 


Next, since we have calculated the first and the third value of 
the cosine with an error of 0.0005 and the second with an absolute 
accuracy, we get the following expression for the computing error: 


А; < t (0.0005 + 2-0 4- 0.0005) = 0.0008, 


Summing up the errors and carrying out the necessary roundings- 
off, we finally obtain 
1 
| cos rz dr 


т=з ie +0.02. A 
--2 
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In conclusion we shall discuss one more technique of 
determining the coefficients A; appearing in the quadra- 
ture formula (2) with specilied nodes. We require that 
formula (2) should be as accurate for tlie functions 1, z, 
а, ... as possible. In this case, we get the following 
system of equations for the coefficients А: 


m, = (b — a) 3 at, (k=0, 1, ..., М). (14) 


If the nodes z; do not coincide and N = n — 1, then 
the determinant of system (14) is a Vandermonde de- 
terminant and the solution of this system (the collection 
of coefficients 4j) exists and is unique. 

We shall prove that such a method of determining quad- 
rature coefficients is equivalent to that described above, 
i.e. that formulas (5) yield the same values for А; as sys- 
tem (14). To prove this fact, we substitute expressions 
(5) Гог the coefficients A; into the right-hand sides of equa- 
tions (14) and interchange the operations of summation 
and integration: 

h 
Wn—1 (2) k 
Ma == | p (2) [2 (z — zi) On- (Za) Ly dr. 
а — 

The expression in brackets is Lagrange’s interpolating 
polynomial of a degree not higher than n — 1 for the func- 
tion z" (k < n). The remainder of such a polynomial is 

d? 


evidently zero (den (^) = 0 for К< п), and therefore 


b 
m, = | р(х) ій с (k=0, 1, ..., п-1). 


It follows from the identities obtained and the uniqueness 
of the solution of system (14) that both methods of con- 
structing the quadrature formulas (2) are equivalent. 
By way of an example, we shall construct a quadra- 
ture formula of the form 
һ 


|o) de = (b—a)| AF (а) + taf (HE) + Al]. 
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То construct such a quadrature formula, we require 
that it should be exact for all polynomials of degree 
zero, one and two. For this purpose, by virtue of the 
linearity of the operations of integration, calculation of 
the values of the function and differentiation, it is suf- 
ficient to require that the quadrature formula should be 
accurate for 1, z, z?. Thus let f (x) = 1 aud then 


(b — a) = (b —a) (A,:0 + A,-1 + Ay:0), io. А, = 1. 
Assume now that f (г) = т and then 


0--а 
2 








HEE c AtA A: + Agel, ie. Ау — Ау. 
Finally, setting f(z) — 22, we get an equation 


SSMO grat c (0) дэ, 





solving which we find that A,:- 26 


Thus the required formula has the form 
К 
l= | Ға) dz 
a 
~ 0-0 | , ath 
= 747 |-0- а) f' (a) 4- (F>) 
--(b— a) f 0 = Í. 
Note that this formula also possesses the property of 
increased accuracy as, for inslance, Simpson's formula. 


Here we give, witliout deriving, the expression for the 
remainder of the formula obtained 


If] 1—13 — уту (0 — а)® У (0), UE (а, 0). 


We invite the reader lo prove the last relation. indepen- 
dently as an exercise. 
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8 6. Quadrature Formulas of the Highest Algebraic 
Degree of Accuracy 


We again consider the quadrature formula 


b т 
IV p) (dex (b—a) 2 Az) =I, (1) 
а i-1 


As we have noted, іп the general case not only Ше 
coefficients A; but also the nodes т, are arbitrary para- 
meters that must be determined in accordance with the 
requirements which relation (1) must satisfy. Since the 
total number of free parameters is 2n, we can expect 
that imposing 2n conditions on relation (1), we shall 
get a system of equations for determining these para- 
meters. We can certainly not find out for sure, in the gener- 
al case, whether the system has a solution at all, and if 
il has, then whether it is unique. We can answer these 
questions ouly after considering the concrete require- 
ments the quadrature formula (1) must satisfy. It is evi- 
dently expedient to connect these requirements with the 
value of the error of formula (1) and to try to choose the 
nodes and the coefficients so as to minimize, in a certain 
sense, the absolute value of the remainder. We pointed 
out in the preceding section that the estimates of the 
errors of the quadrature formulas were attained on poly- 
nomials whose degree exceeded by unity the maximum 
degree of the polynomial for which the corresponding 
quadrature was exact. It is natural therefore to trv and 
increase the degree of the polynomial for which for.nula 
(2) would be absolutely exact. Such a posing of the 
problem generates the following optimization prob- 
fem. 

We have lo construct a quadrature formula of type (1) 
wilh a fixed п, accurate for an arbitrary polynomial of 
degree ғ as high as possible. 

We shall show that this problem is equivalent to the 
problem of constructing the quadrature formula (1) 
which is accurate for all functions z^ (k = 0, 1,..., г). 
Indeed, assume that we have an arbitrary polynomial 
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P, (x) = È anı”. Then 
=0 
R,|P,] = 7|P,] — I, (P,] 


r b n 
=D a (Vo(22*dz— 2 Ait) 
һ=0 а ігі 
=} aR, [2%]. (2) 


> 
| 
o 


From this, by virtue of the arbitrariness of a, (the poly- 
nomial P, is arbitrary), we find thal for А, [P,] = 0 it 
is necessary that А, [x*] = 0 (k = 0, 1, ..., r). The 
sufficiency is a direct consequence of Ше linearity of the 
remainder of formula (1) with respect to the function f 
and is obvious by virtue of the same relation (2). 

We thus arrive at a system of г + 1 equations for 2n 
unknown parameters А; and т: 


b n 
m, = | р(х) zt dz —(b—a) >) Ал? (k=0, 4, ..., г). (3) 
=! 


а 


It is natural to try and solve this system, i.e. construct 
a quadrature formula for r + 1 = 2n (the number of 
equations is equal to the number of unknowns). The theo- 
rems presented below substantiate the expediency of 
this attempt. 

We shall first formulate without proof an auxiliary theo- 
rem which characterizes the properties of orthogonal 
polynomials. 

Theorem 1. Assume that: (1°) p (х) > 0 almost everywhere 
оп (а, b), (2°) Pn- (х) is an arbitrary polynomial of de- 
gree not higher than n —1. Then there is a polynomial 


V, (z) = (2 — z) (т —2,)..- (£ — г.) (4) 


orthogonal to Р,- (т) with weight p (т), i.e. such that 
b 


ы | p (z) V (x) P, (г) dz —0, (5) 
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all its roots ху, z4, ..., 7, being distinct and lying within 
the interval (а, b], and this polynomial is unique. 

We shall now consider theorems which make it possible 
to find directly the nodes and coefficients of formula (1) 
which is accurate for all polynomials of degree 
г = 2n — 1. 

Theorem 2. For formula (1) to be accurate for polynomi- 
als of degree Әп — 1, it is necessary and sufficient that: 
(1°) the nodes т; be roots of the polynomial ¥ „ defined by re- 
lation (5), (2^) the weight factors A, be defined by relation 
(5) from 8.5. 

Г] We begin with the necessity of condition 2°. If 
formula (1) is accurate for all polynomials of degree 
2n — 1, then it is also accurate for polynomials of any 
lower degree, the degree n — 1 inclusive: then this for- 
mula is interpolating and we get a unique collection of 
cocfficients A, defined by formula (5) from 8.5. 

Let us consider a polynomial Q,,., = «,-4(r) P n-alt). 
Using the fact that formula (1) is accurate for the poly- 
nomial Q,,., (т), we obtain condition 1°: 

b n 


| p (2) о. (2) Pami (0) d2 = (0—0) 2 Aia (2) ~ 0. 


е 1=1 


The last relation follows from the fact that w,~,(2;) == 0 
for all i = 1, 2, ..., n. 

We shall verify the sufliciency of conditions 1 and 
2’. We represent the arbitrary polynomial Qn (г) 
of degree 2n — 1 as 


Qoia = У.Р, (г) + Sn (2), 


where P, , and $, , are the quotient and the remainder 
of the division of the polynomial Q,,., by the poly- 
nomial VW, respectively, P, , being a polynomial of 
degree n —1 and S,_,, a polynomial of degree not 
higher than n — 1. Next we have 


h b h 
| p) Qani de= | р(а) УАР, de \ pt) Sni de. 


The first term on the right-hand side is zero by virtue of 
the orthogonality of V, and P, , (condition 1°) and for 
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the second term formula (1) is accurate by virtue of con- 
dition 2°. Therefore, taking into account that Q4, (г) = 
8,1 (rj) since V, (rj) = 0, we finally obtain 


b n 
| o (2) Gu. dz (b—a) 2 AQ (=). Ш 
a i=l 


The next question is whether it is possible to construct 
the quadrature formula (1) accurate for all polynomials 
of degree higher than 2m — 1. The following theorem 
answers this question. 

Theorem 3. Let p (x) >U almost everywhere оп |a, bl. 
Then there is no quadrature formula of {уре (1) accurate 
for all polynomials of degree 2n. 

O We consider a polynomial Q,,(x)-—(x—z,) ... 
(r—z,)!'— «e» (x). Then the left-hand side of relation 

b 
(1) is | р(х) on- (т) dz > 0 whereas its right-hand side is 


a 
n . 
У Ао? 1(74)--0, and this proves the theorem. M 
с 


Thus the quadrature formula (1) with nodes х; defined 
by relation (5) and coefficients 4, defined by relation 
(5) from 8.5 is accurate for any polynomial of degree nol 
higher than 2n — 1. It is known as a quadrature formula 
of the highest algebraic degree of accuracy (or the Gaussian 
quadrature - formula). 

The Gaussian formula possesses a property useful from 
the point of view of computing error: all coefficients A, 


(i = 1, 2, ..., n) are positive for any n. 
To prove this statement, we consider a function 
2 А А . . . 
[229] which is a polynomial of degree 24 — 2 and 
—— р - 


which vanishes at all nodes г; Æ гр. The Gaussian for- 
mula is accurate for this function and therefore 
b 


"P y? 
ШЕР 


z— zy) 


dz = (b — a) A, [Y (z,)F. 


a 


It follows immediately that A, — 0. Since p is arbitrary, 
all quadrature coefficients А; evidently exceed zero. 
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We shall now estimate the error of the Gaussian quad- 
rature formula. 

Theorem 4. Assume that: (1°) р (г) с>>0 almost every- 
where on (а, b], (2°) f (x) € C?" la, b], (3°) х, and A, 
(i = 1, 2, ..., n) are the nodes and the coefficients of 
the Gaussian quadrature formula respectively. Then there 
is a point E € (a, b) such that 


b 
R= 8 | p@ot ede. (6) 


a 


O We represent the function being integrated as 


Қа) Mans (2) A A оз, (2), € (a, 0), 


where Zyn- (2) is the Hermitian interpolating poly- 
nomial of cecree not higher than 2н — 1 with double 
nodes ду (£ == 1, 2, ..., m. Evidently, the Gaussian for- 
mula is exact for an-ı (г). Therefore 


b 
1 ‘ 24) [ny pot 
1:-1, TE \ p (2) /® (n) on, (z) dz. 


а 


Applying the second theorem of the mean to the second 
terin on the right-hand side and transferring 7, io the 
left-hand side, we get tlie required relation (6). g 

In practice, the Gaussian quadrature is usually ob- 
tained as follows. Wo first find the roots of the роіупошізі 
Va (т) which is orthogonal to all polynomials of degree 
lower than x. Then we construct a system of lincar equa- 
Lions for the coefficients A; assuming that the quadrature 


formula is valid for the functions 1, 2, ..., 27): 
b n 
. ! 
m, = \ p (2) x" dz— >) Ату. 
а i-l 


Solving this system, we find A,. 
Formula (22) constructed in 8.4 is the simplest illustra- 
lion of the Gaussian quadrature, 
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8.7. Compounded Quadrature Formulas 


Formulas with a large number of equispaced nodes are 
not widely used. There are various reasons for this. First, 
for functions which have a singularity not on the integra- 
tion interval itself but in its vicinity, the remainder of 
a quadrature formula of a high order is large, as a rule. 
And what is more, when the nodal points are equally 
spaced, even for some analytic functions, it is possible 
that R,[f] = I —1I,— oo as п--о:. Second, for 
nz 10 there are negative coefficients among H,, and this 
lead: to an essential increase in the expected computing 
error. Indeed, assume that all the values f, of the func- 
tion z appearing in formula (8) from 8.5 are given with 
the same accuracy е. Then we can estimate the total com- 


n 
puting error by the quantity A, = (b —a) e >) |", |. 
іші 


Since the sum of all Cotes coeflicienls is equal to unity, 
it follows that if there are negative coefficients among 
them, the value of A, is increased. Table 8.2 demon- 
strates the rate of growth of A,. 


Table 8.2 
n | 10 | 15 | 2U 
n 
У | Ha | м3 м8 де 560 
4-і 


Formulas of the Gaussian type possess delinite advan- 
tages as compared witii the Newton-Cotes formulas since 
they are free from the drawbacks described above. How- 
ever, being formulas of the highest algebraic degree of 
accuracy, the Gaussian formulas have, for large n, a 
remainder which is proportional to the derivativo of 
the function being integrated whose order is high. This 
is an essential drawback as concerns the integration of 
functions which do not possess continuous derivatives 
of higher, orders or of empirically constructed functions. 
Besides this, even for convergent quadrature processes 
constructed by means of Gaussian formulas it is usually 
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not known in advance how high n must he for the conver- 
gence to begin in practice, i.e. it is not known in advance 
how high п must be for the required accuracy to be en- 
sured. 

For these reasons, the so-called compounded (generalized) 
formulas are usually preferred in practical calculations. 
The essence of these formulas is that the interval of in- 
tegration (а, b] is divided into several subintervals, 
some quadrature formula with small n is applied to each 
subinterval and the results are added together. 

The expediency of such an approach is based on the 
following arguments. For many quadrature formulas, 
including those considered in this chapter, the remainder 
is proportional to the power of the length of the inle- 
gration interval. Assume, for instance, that the applica- 
tion of some chosen quadrature formula to the interval 
(а, ^] yields the following expression for the remainder: 


R If] = (b — aq (a, 0), (t) 


where ф (а, b) is a slowly varying function of the inte- 
gration interval. 

Dividing the original interval into m equal subinter- 
vals and applying the same quadrature formula to each 
of them, we lind that on each subinterval the remainder 
is approximately т^ times as small as in (1). Adding to- 
gether the results of integration and the remainders, 
we find that the error of the original integral is approx- 
imately m^-! times as small as in the case when we 
apply the chosen quadrature formula to the whole ori- 
ginal interval. 

This method is general enough and may be realized for 
any quadrature formula. 

The rectangular formula (4) with remainder (8) consid- 
ered in 8.5 is the simplest example of a compounded 
quadrature formula. 

We shall discuss compounded formulas which are most 
frequently used and which are based on the simplest 
quadratures presented earlier. 

Compounded trapezoid formula. Assume that we һауе 
to calculate the integral of the function f on the interval 
(а, 81. We divide the interval (а, b] into m equal subin- 
tervals with boundary points a = zy, т, ..., Zm = 0 
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so that the length of each subinterval is k = (b — а)/т. 
We represent the integral as the sum 
x 


b хі т 
Mese eoe ende ШІСІ 


and to each term on the right-hand side of this relation 
apply the trapezoid formula with a remainder [see rela- 
tions (11) and (12) in 8.5]. Collecting terms, we obtain 


b m-1 
fee CP 1) 
i=1 


a 





s -z fn) NiE (Tiis т). (2) 


Assuming that the second derivative of the function being 
integrated is continuous throughout the interval [a, 5], 
we have, by virtue of Weicrstrass’ theorem, 


д i” (n) = тј" (n, nc (a, b). 


Substituting this expression for tlio sum iuto relation (2), 
we gel a compounded trapezoid formula 


m-i 
г= \ ае tat (ұл i ЛЕН (3) 
i-i 


with a remainder 


Rp = -EZE у" (т). (4) 


Consequently, we can represent the estimate of the error 
of quadrature (3) in the form 


5 n 
A= 11-1 < 2" м, (5) 


where M, = тах | /" (т) |. The estimate obtained can- 
[а, 5] 





not be improved since it is attained, say, on the parabola 
f = 22, which fact can be proved by a direct verification. 
Note that we have performed similar calculations when 
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we analysed the quadrature formula (4) in 8.4. See how 
this can be done for the compounded formula (3). 

We calculate the left-hand side of the quadrature 
formula (3) for f = 22: 





b 
b3 —- a? 
= 2 = 
І ( 12 (= 3 . 
а 


We calculate the sum: 
m-i 


n "e [ч у (asi +y]. 


ізгі 





Transforming the expression in brackets and using the 
following formulas for summation: 


т-і т-1 

> i- (m—1)m > B (m —1) m (2m —1) 
2 Е 6 

i-1 i=! 


we get the required quantity 





Ьа аз (b—a)? 
т.. 4. 
I І | üm? 


Thus the error of the quadrature formula (3) for the 
function / = 27 is 
—g) 
А,=11—1г| c SX, 
and this exactly coincides with the right-hand side oi es- 
timate (5) since M, = 2. 

Since the operations ГІЛ and ІЗІЛ are linear and 
formula (3) is accurate for any linear function, we can 
assert that estimate (5) is altained on a second-degree ar- 
bitrary parabola. 

Expression (5) for the error A, of the method of the quad- 
rature formula (3) shows that lim A, = 0, i.e. increasing 

т-» оо 
m, we can ensure any preassigned accuracy 7/7 in the 
sense of the error of the method (when there is no com- 
7 puting error) In such cases we say that the method is 
convergent. |t remains to find out how the error of the 
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initial data (the values /, of the function) affects the 
error of the result. Since the right-hand side of the quad- 
rature formula (3) is linear with respect to the values of 
the function being integrated, the total computing error 
is proportional to the error of calculation of each value 
of the function (provided that they are equal). We can there- 
fore expect that when the initial data are sufficiently 
accurate, the total computing error will be sufficiently 
small. 

We shall derive formulas for the number of divisions 
m aud the permissible error of each value /; of the func- 
tion, which ensure the required accuracy в when use is 
made of the quadrature formula (3) with error (5). 

First of all, using the algorithm of solving Problem II 
given in 8.3, we represent e as the sum е = & + £ -- 
єз (if, for instance, в = 10-^, then we usually set 
e = 0.3-10-^, е, = 0.2-10-*, в, = 0.5-10-^). 

Next we choose the number of divisions m for which 
the inequality A, < e, will be satisfied. For this purpose, 
by virtue of (5), it is sufficient to require that 


(b —a)3 


12m? M; x e. 





Transforming this inequality, we get the following for- 
mula for ihe number of divisions: 


` m> 0-а y S | (6) 


Thus the error of the method A, does not exceed e, if the 
number of divisions m satishes inequality (6). 

Let us find out what must be the error of the values of 
the function being integrated for the total error of calculat- 
ing 17 from formula (3) not to exceed e,. Let the required 
error be A [fj]. Then, using formula (3), we obtain 


AUT] sz 5—* (A [fi + (m— 1) A fil) = (6 a) АТЫ. 





Consequently, for the inequality A [/7]x е; to hold 
true, it із sufficient to require that 


A [fi] S ey (b — a). (7) 
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Example н. Using the compounded trapezoid formula, calculate 
the integral | E with an accuracy of 0.04, 


0 

A Let fe D.004, ез 0.001, eg 20,005. We find thal Мә = 
max (o ) | 22. Employing inequality (6), we find the number 
[0,1]! 44-2 
of divisions we need: 


(ї—п).2 6 
т>(1--0). V oe 120.004 9-4 


We assume that m := 7. Inequality (7) yields a value A [fj] = 
0.001 for the permissible error of the values of the integrand. 
We compile a table of the necessary values of the function being 
integrated with three valid digits: 





z |o pur [эл (an [ат Гат | n | 
(14- әсі | 4 | 9.875 | 0.778 | 0.700 | 0.636 | 0.583 0.538 | 0.500 


From formula (3) we obtain 


LE (im 


1-- 
naz 





+0875 -|-0.778 + 0.700 -|-0.636 


+0.5834-0.538) = (0.694. 
Rounding off the result obtained, we finally have 
1 


' dz 
-20.69 4- 0.0L, 
тра 





Compare the solution we have obtained with that of Examyle 6 
from 8.4 and Example 3 from 8.5. A 


Simpson's compounded formula. In this case we divide 
the integration interval into an even number 2т of equal 
subintervals with boundary points а = Zo 2... 
Lo, = b so that the length of each subinterval is 
h = (b — ay(2m). We represent the integral as the sum 


J rae. [reae \ f (x)dz-F...-F 1 f (x) dz. 


We apply Simpsou's formula with a remainder [see 
relations (11) and (12) from 8.5] to each term on the 


27-0104 
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right-hand side of this relation. Collecting terms, we 
obtain 





b 
| fi dz ut Mot fam + 405 + 20%) 


5 
-e-a У ПУ (nj), (8) 
dizi 
Ti C (321-8; їл); 

9,7 fi fat... thems 93 fat fit o Ља 
Assuming that the fourth derivative of the function being 
integrated is continuous on the whole interval [a, 5], 
we have, by virtue of Woierstrass' theorem a relation 


SAY (n= nf (т), nela 0). 


Substituting the expression obtained for the sum of the 
derivatives into relation (8), we arrive at Simpson's com- 
pounded formula 

b 


Le (z) dz = А 
4 - fft „+ fam- 93 fat fit -+ fama 


with a remainder 


RẸ ifl = — C2 fi (т), ne(a, b). (10) 


Consequently, we can represent the estimate of the er- 
ror of the quadrature formula (9) as 


b— 
A= HIR < д My (11) 


where M, = шах |f!V (z)]. This estimate cannot be im- 
[a,b] 








—* (fot fam +40, +20) = IT, (9) 


proved since it is attained, say, on the function f= z$, 

By analogy with the trapezoid formula, we shall get 
specific formula for the number of divisions m and the per- 
missible error for each value f, which ensures the required 
accuracy of в when formula (9) is used with error (11). 
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Let e = е; +e, + ғу. Taking relation (11) into 
account, we require, for the inequality A,< e, that 


(b —а)5 


288m. Mi S e 


From this we find the condition for the number of divi- 
sions 2m for which the error of the method does not ex- 


ceed е;: 
b— 
2m > (b—a) }/ 20 Me va. (12) 


We shall find out now what the error of the values of the 
integrand should be for the total error of calculating Г" 
from formula (9) not to exceed &,. Let the required error 
be A [fj]. Then, using formula (9), we have 


[A UE] « = 
4 S —1) A (fi) = (5 — a) A Lf]. 


Consequently, for the inequality A [7°] < е) to hold 
true, it is sufficient to require that 


A [fi] « е,/ (b — a). (13) 





As could be expected, we have got the same result as for 
the trapezoid formula. This is because both formulas (3) 
and (9) are of the same kind (3) from 8.3, all the coeffi- 
cients А, being positive and their sum equal to unity. 


Ш Example 2. Using Simpson's compounded formula, calculate 
1 


the integral | 12. with an accuracy of 0.001. 
A Let e, — 0.00045, ез = 0.00005, ву == 000005, We find that 


М = max ( 
‘ max | 1+ 


we find the number of divisions we must make: 


^"a—uy24 
2m > (1—0). V os 180-0.0045 4! 
Since 2m is an even number, we assume that 2m = 6. Inequality (13) 
for the permissible error of the values of the int>grand yields a val- 
27* 





IV 
) |=2. With the aid of inequalities (12) 
» 
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ue A [fj] — 0.00005. We compile a table of necessary values of 
the integrand with four valid digits: 


z [o] 1/6 | 206 | 3/6 | 4% | 5/6 | 1 
(1+ 2)-1 ІҢ 0.8571 | 0.75 | 0.6667 | 0.6 | 0,5455 | 0.5 


From formula (9) we find that 
— i) 
R= ы [14-0.5 4- 4- (0.8571 -]- 0.6067 4 0.5455) 
4-2-(0.75-1-0,0)| = 0.69317 ... 


Rounding off the result, we finally have 





1 
^ dz 

шші),6С ТЕ! . 
БЕ 693 + 0.001. А 
9 


Let us analyse the result obtained іп Example 2. Comparing the 

approximate value /3 — 0.69317 . . . with the exact value of the 
integral Z -: 0.69314 . . ., we note Lhat the real difference of the 
exacl and Lhe approximate value (about 0.00003) is approximate- 
іу 17 times smaller than the preassigned permissible error (e, j- 
Ea = 0.0005). A natural question arises: why is the dillerence of the 
theoretically predicted and the practically obtained error so 
great? 
Before answering this question, we point out that such a differ- 
ence between the true error and the estimate required can be 
observed not very frequently and can be predicted in cases similar 
to that considered in Example 2. And what is more, il can be 
reduced to a,minimum by taking into account some auxiliary 
considerations and construcling more cleverly the computation 
process. 

Indeed, in Example 2, by virtue of inequality (12), the error of 
the method 0.0004 is associated wilh the number of divisions 2m > 
4. .... We could not choose the limiting value 4,1... since 
2m must be integral and even and the least permissible value 2m = 
6 we have chosen is naturally associated with а smaller error of 
the method, approximately equal to 0.0001. This is the first cause 
for a decrease in the practical error. 

Next, although all the estimates of the error were the least and 
could not be improved, they were attained on polynomials whose 
derivative appearing as a factor in Lhe expression for the remainder 
was a constant quantity. Now if this derivative varies considerably 
on the interval of integration (and this is quite natural when the 
interval is large), then the corresponding estimate proves to be far 
from optimal, as a rule. If this is the case, it is expedient to deter- 
mine the number of divisions proceeding from the form of the 
remainder given in relations (2) and (8). For Simpson's formula, 
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for instance, we would get the following inequality for 2m: 


m 
(b -—а)? 1 pri А А 
18 ! (2m)4 2 "ажа, (14) 
1—1 
where Мі-. тах v (г) |. Evidently, for great variations 


СЕ" 
of the fourth derivative on the integration interval, inequality (14) 
4 M, 


тп 
(1/m) У) M; 
i.l 
as concerns the number of divisions. In principle, we sec under the 
sign of the root the ratio between the maximum absolute value of 
the fourth derivative thróughout the integration interval and its 
mean value calculated for i intervals г.) 4. rag], 1-5 1,2... .. m. 
Thus the use of inequality (14) in Example 2 for the number of 
divisions yields a value 2m с 4 and for 2m -- 6 the estimate of the 
error of the method comes down to 0.000045. and this is only one 
and a half time !^rger than the true error. This is а good result. 


із times as advantageous as inequality (12) 


Exercises 





s 


I. Calculate the definite integral | z24-2dr using the for- 


тое o, x 


mula for left rectangles for n- 6. 
2. Using the formula for right rectangles for н —8, calculate 











9 
“ dr 
11-14 
1 
t d 
3. Using the trapezoid formula tor n 8, calculate | iz 
n 
5 
. por l dr . 
4. Using the trapezoid formula, calculate | -у--- setting 
) y z--4 
n D. 
1 | 
А : dr . А 
5. From Simpson's formula calculate | ag setting 2m : 1. 
“ de 


0 
1 


. Calculate | COS 2 


14r 


c 


dr using Simpson's formula. Set 2m — 10. 
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1 
7. Calculate the integral | 2323 using the Gaussian quadrature 
-1 


formula for 2m — 6. 
8. The function is tabulated as follows: 


z | 0.525 | 0.526 | 0.527 | 0.528 
|! | ози | 0.5258 | 0.50294 | 0.50381 


Using the method of numerical differentiation, find the first deriv- 
ative at the point z* = 0.525. 

9. Find the first derivative at the point z* — 50 for a function 
given as the [following table: 


z | 50 | 55 | б |06 
f | 4.6990 | 4.7404 | 4.7782 1.8129 


1 
10. Calculato the integral Ше dz with an accuracy of в: 


(а) f (т) = z*coS =, е = 0.001 ‚ (b) f (т) = z? зіп г, = = 0.001, 
(с) f(z) = хех, е = 0.0001, (4) f(z) = г V хех, в = 0.0001, 


(e) f (z) = «7, e = 0.0001, (f) f (z) = e*V =, e = 0.0001, (g) f (x)= 
т? + T = 0.0001, (h) f (г) = зіп г, е = 0.001, (i) f (г) = ех, 
e — 0. . 

11. Calculate the values of the derivative of the function f (z) 
at the point z = г) using the four-digit tables of trigonometric func- 
tions with astepsize of 1°. Find the absolute value of the result. 

(а) f (z) = sin z, ту = 41°, (b) f (г) = cos z, г, = 27.5°, (c) f (x)= 
tan z, =; = 50°, (d) f(z) = sinz, г, = 17930’, (е) f(z) = 
cos z, ту = 63°, (f) f (г) = tan г, z, = 59, 


Chapter 9 


Approximate Solutions of 
Ordinary Differential Equations 


9.1. Differential Equations 


Ап equation in which the unknown function is under 
the sign of the derivative or differential is a differential 
equatlon, for example 

м dy d?y 0% 0% 
1—2 (0—3), ча = 1, 3s tar = 0, 


dz dt? 
y' -z*, zdy = у? dr. 


If the unknown function entering into a differential 
equation depends only on one independent variable, the 
differential equation is ordinary. The differential equa- 
tions 


тї. l2, 2sdt —t ds 


are of this kind. 

Now if the unknown function entering into a differen- 
tial equation is a function of two or more independent 
variables, then it is a partial differential equation. For 
instance, the equation 

0% 922 
art 1 ду? 
іѕ а partial differential equation. 

The order of a differential equation is the highest order 
of the derivative (or of the differential) entering into 
the equation. For instance, the equations 

d?s 9% 9% 





=0 


are of the second order and the equations 
a -cost+sint--1, (z?—y?) dr 4- (12+ y?) dy — 0 


are of the first order. 
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In this chapter we study only ordinary differential 
equations. 

In the most general case an ordinary differential equa- 
tion of order n contains an independent variable, an un- 
known function and its derivatives or differentials up 
ilo order n inclusive and has the form 


F (£, у, у, ys, ..., ym) — 0. (1) 
Іп this equation z is an independent variable, y is ап un- 
known function, у’, y',..., y™ are derivatives of 


this function. , 

If the left-hand side of the differential equation (1) 
is a polynomial with respect to the derivative of the 
unknown function, then the degree of this polynomial is 
the degree of the differential equation. 

For instance, the equation 


"Y "үз 6 ! - 
QD) ry =y | at = 0 
is a second-order equation of the fourth degree and the 
equalion 


(yY 1 235 — y8 4 219 - 0 


is a first-order equation of the second degree. 
An nth-order differential equation resolved for the high- 
est derivative can be wrilten as . 


y = f (£, у, у, у, oe YO), (2) 


The solutign (or integral) of equation (2) is any differ- 
enliable function y =: (г) which satisfies this equation, 
i.e. such that being substituted into equation (2), it turns 
the equation into an idenlit y. 

The graph of the solution of an ordinary differential 
equation is known as the integral curre of this equation. 

The solution of a differential equation which contains 
as many independent arbitrary constanls (parameters) 
as iis order is a general solution (or general integral) of 
this equation. 

In terms of geometry, the general solution of a differ- 
enlial equation is a family of integral curves of that 
equation. 

A particular solution of a differential equation is any 
solution which can be selected from the general solution by 


Ch. 9. Appreximate Solving of Ordinary Differential Equations 425 


giving a definite set of values to the arbitrary constants. 

The arbitrary constants entering into the general so- 
lution are found from the so-called initial conditions. 

A problem with initial conditions is posed as follows: 
find the solution y = ọ (x) of the equation у = 
fi, у, y, yY”, yo) which satisfies the auxiliary 
conditions that the solution y = Фф (zr) must assume, 
together with ils derivatives up to the order n — 1, 
the preassigned numerical values Yo, Yo Yor -~ yg 
for the given numerical value z — г, of the independent 
variable и: 

Yo Yor Y'= Yor ус eso JUD aD for x oar. 


(3) 
Conditions (3) are the initial condilions or values, the 
numbers £o Yor Yor Yor 5 Yo) are the initial data 


of the solution, and the problem of finding the solution 
y oc: ар (т) of the differential equation (2), satisfying the 
initial conditions (3), is an initial-value problem (or 
Cauchy's ii hlen), 

In the case of a first-order equation, i.e. when n =-1, 
we get Cauchy's problem for the equation у’ = f (ғ, y) 
with the initial condition x == zy, y = Yo. 

In lerms of geometry, Cauchy's problem (for a lirst- 
order equation) consists in isolaling, from the whole 
set of integral curves which constitutes the general so- 
lution, the integral curve which passes through the point 
Ма wilh coordinates £ =- ay, Y = Yo. 

Example. The general solution of the differential equation 
E =- 2c, with the initial condition yọ = 2 for rẹ - 1, has the torm 
y = a? | C.Tt is a family of parabolas. If we substitute the initial 
data into the general solution, we get 2 -= 1-j- C, i.e. C = 1. 
Consequently, the particular solution which satisfies the indicated 
initial condition is y т? | 1. In terms of geometry, this means 
that from the whole set of parabolas which constitute the general 
solution of the differential equation we choose the parabola which. 
passes through the point M, (1, 2) (Fig. 9.1). 

Cauchy's problem has a unique solution which satis- 
fies the condition y (rj) = Ya if the function / (гт, y) is. 
continuous in a certain domain Ria») = {|£ — To |< 
a, |y —Ya | <b} and satishes, іп this domain, the 
Lipschitz condition 


If 1 DINI) у | 
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where № is the Lipschitz constant dependent on a and b 
(a and b are the boundaries of the domain). 

The methods of the exact integration of a differential 
equation suit only a small part of the equations which 
are encountered in practice. 

Therefore of considerable significance are approximate 
methods of solving differential equations which can һе 





Fig. 9.1 


divided into two groups according to the form of the 
representation of the solution: 

(1) analytic methods which give an approximate so- 
lution of a differential equation in the form of an ana- 
lytic expression, 

(2) numerical methods which give an approximale so- 
Ішіоп in the form of a table. 

For the first group of methods, we discuss in this chap- 
ter the method of successive approximations (Picard's meth- 
od) and the method of integration of differential equa- 
tions by means of power series, and for the second group, 
Euler's method and its modifications, the methods of 
Runge-Kutta and Adams. 


9.2. The Method of Successive Approximations 
(Picard’s Method) 


This method was first used in the process of proving the 
theorem» of the existence and uniqueness of the solution 
of differential equations. It is known as Picard’s method. 
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Consider an equation 
y =f у) (1) 


whose right-hand side is continuous in the rectangle 
{|z — To |<a, |Y — Yo |< b) and has a continuous 
partial derivative with respect to y. We have to find a 
solution of equation (1) which satisfies the initial con- 
dition 

т = ту, Y (ғ) = Yo. (2) 


Integrating both sides of the equation from 70 to z, we 
obtain 


| dy - ( Ка, y) dz, 
ог: 
уба) -- vo | f(x, y) dz. (3) 


Xo 


Equation (1) is replaced by the integral equation (3) in 
which the unknown function y is under the integral sign. 
The integral equation (3) satisfies the differential equa- 
tion (1) апа the initial condition (2). Indeed, 


x 


y (19) = Yo -F | Қа, y) dz = yo. 


Xo 


Replacing the function y in relation (3) by its value yy, 
we get the first approximation 
x 
y) -yot f Gn Yo) da. 


Then we replace y in relation (3) by the value y, already 
found and get the second approximalion 


Yo (1) = Y+ | Қа, уу) dz. 
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Continuing the process, we find in succession 


x 


ys (2) = yo | f(z, ys) da, 


Yn (x) = Yo t- | f(x, Yn-1) dz. 


Хә 
Thus we form a sequence of functions 


Yı (г), Ya (г), Ya (0s 5 Yn (т). 


The following tlieorem, which we give without proof, 
is valid. 

Theorem. Assume that the function f (ғ, y) is continuous 
and has a bounded partial derivative fọ (ғ, y) in the neigh- 
bourhood of the point (rq, yg). Then, in a certain interval, 
which contains the point хо, the sequence (y, (x)} converges 
to the function y (x) which is a solution of the differential 
equation y = f (x, y) and satisfies the condition y (су) = 


0“ 

The estimate of the error of Picard’s method сап be 
found from the formula 

« М"М LE 4 

|у—у„| < ГЕ ЕТТІ (4) 

where M = max | f (2, y) | for x, y € Hj,,,; and N is 

the Lipschitz constant for the domain Шам) equal lo 

N = max | /, (x, y) |. The quantity k for determining 

the domain [z, — AS г< to -j- A] сап be calculated 

from ihe formula 


А == min (a, 6// М), (5) 
where а and b are the boundaries of the domain Л, 
Example. Use Picard's method to solve the differential equation 


y' = z? 4 y? satisfying the initial conditon ху = 0, y (zy) = 


Vo = 0. 
° A We pass to the integral equation 


у= + | (z? + y?) dz, 
ub 
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or, with due account for the initial conditions, to 
x 
y= [tun ds. 
0 


We get the successive approximations 


х = А 
n= | е) = | 20) й, 
0 0 ` 
5 T zê a гї 
n= | е | (+4) а= 4+, 
0 0 
^ 2 zê 9:9 ги 
m= | а Maem | (+244 gs) ae 
0 0 


T3 т? 271 r1 
741141 279 | 59 535" 


We use formula (4) to estimate tlie error of thethird approximation: 
hu 


a nM — 
І9-Һңіті SN м TETTE 


Since the function y^ — г? [- y? is defined and continuous on the 
entire plane, we can take any numbers as a and b. For definiteness 
we choose а rectangle 
R {| z-- ty [S 0.5, [y — val th 
i.e. R (— 0,5< т< 0.5, — 1 y « 1). 
Then 
M =- max | f (2, y) | = max (r? -|- y?) = 1.25, 
N = max | fy (т, y) | ^ max [3y [ == 2. 
Since a — 0.5, В/М - 0.8, we have, in accordance with for- 
mula (5), 
h = min (a, 0/ М) = 0.5. 
The solution y will be defined for — 0.5 xz r < 0.5. For n = 3 
we find that 
| y — y; | & 1.25. 23.0.59/4! = 5/192. 


We have got a very rough estimate of the error. in actual fact the 
error is considerably smaller. A 
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9.3. Integrating Differential Equations by 
Means of Power Series 


The method of successive differentiation. Consider an 
nth-order differential equation 


y? = f (T, Y, у, ..., YO) (1) 
with the initial conditions 
T= Tos Y (To) = Yos V' (Zo) = Vos ..., YOP (T0) = yn. 
(2) 


The right-hand side of this equation is an analytic func- 
tion at the initial point Mj, (Zos Jo Yor -- 51). 
We represent the solution у = у (г) of equation (1) in 
the neighbourhood of the point =, as a Taylor series 


Y == Vo + Vo (ea) + ecu 





07 (z —r9) --..., (3) 


where | z — Tọ | < and й is a sufficiently small quan- 
lity. To find the coefficients of series (3), we differentiate 
equation (1) with respect to z as many times as neces- 
sary, using conditions (2). 

In practical calculations, the quantity |z — Tọ | is 
taken so small that for the required degree of accuracy 
the remainder of the series can be neglected. 

И 2, = 0, we get a Taylor series in the powers of z: 


im) 


Y= у 40024-39. srt, ed Bat... (4) 


Example 1. Find a solution of the differential equation y =: 
y — Az +3 which would satisfy the initial condition =, = 0, 


А Substituting Vo = 3 into expansion M we obtain 





yop hep Hay si amy...) 


Successively differentiating this equation, we have 
a 


у= у і4-шу- 4-і, y" = у" = у — 4 — 1, у 
= уШ and so on. 


IV 
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Using the initial condition, we find that 
Yo = yo — 470 + 3 = 3 + 3 = 6, y" = yo — й — 1= 3 ~ 1 = 2, 
yo = 2, E EEE =2. 


Substituting yo, yo. vo into the right-hand side of relation (*), 
we obtain 


= Жу Жр 
y=3+ 62- z*-| 3 | iz t 4... 
The function 
y = 2e* + áz 4- 1 
is the exact soultion of the given equation. 


If we set k = 0.1, we can compile a table of values of the solu- 
tion of the given differential equation. 4 


Table 9.1 


= 








0.1 | 0.2 | 0.3 


Тһе values obtained from 

the analytic solution 3 3.6021 | 4.2428 | 4.8996 
An approximate solution 

by means of a power series | 3 3.6103 | 4.2427 | 4.8999 


Example 2. Find a solution of the differential equation y" — 
а?у = which would satisfy the initial condition zy = 0, yo = 1, 
yo = 0. 

° A Asin Example 1, we shall seek the solution of this equation 
as а series (4) in the powers of т. Since yy = 1, yo = 0, series (4) 
has the form 


ydp ME ep дзр MA un р... . (») 
2! з! n 
We rewrite the given differential equation as y" = z?y. Succes- 
sively differentiating this relation, we have 
y^ = 2zy 4- z?y', 
Т = 2y 4- 22y' + 22у' + 22y" = 2y H 4ту' + 2%", 
y = 2y! + 4y! + 4zy’+ 2zy -H 22у" = by’ + zy" 4- z1y", 
yl = 12y" 4-82" aty, 
yV11 = 20y" + 10zy! V + азу, 
yn = БАЛЫМ + 12zyV + 23yV! . 
Substituting successively the initial conditions х, = 0, y 


= 1 
yo = 0 into each of the relations obtained, we get y (0) -- 0 
yu (0)—0, y" (0)— 2, y" — yl = yH = 0, у!!! = 30-2=60. 
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Substituting finally y", y", yl V. . . into the right-hand side of 
relation (ж), we get the required solution 


1 1 
—44 42. в. 
у= 14 12 Т' toz? l- А 


The method of expanding a solution in a series can 
also be used to solve systems of ordinary differential 
equations. 


Example 3. Find a solution of the system 


т А 
— = 20081 — узіп Ї 
dt У , 


dy... 
dr = 2 5іпі--усов1, 
which would satisfy the initial conditions z (0) = 1, y (0) = 0. 
A^ We set 
т" (0) 
3! 


yy Q)-E OEY wt {- ro pus 





== ()4-2 0) t4-2 (0) 5 | 04 ..., 





Differentiating the equations of the system, we obtain 
т” = z'cost — z sint — у sin? — y cos f, 
y" = z' sint -+ z cos t + у’ cos t — y sin t and so on. 


Substituting in succession the initial conditions into each of the re- 
lations obtained, we find that z' (0) = cos t|, = 1, y’ (0) = 0, 
т” (0) = 1, y" (0) = 1, г” (0) = 0, y”’ (0) == З and so on. 

The required solution has the form 


1? і? ы 
г--1-4---2-4- езуі . ù А 


The method of undetermined coefficients. Consider a 
differential equation 
у = f (т, y) (5) 


with the initial condition y (70) = yp. The method of 
undetermined coefficients consists in seeking а solu- 
tion of equation (5) in the form of a series with unknown 
coefficients 


“у = ao + a (£ — To) + а (£ —т„)* 
+ dy (£ —z) + .. (6) 
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which we can find by substituting series (6) into equation 
(5), equating the coefficients in the like powers of т and 
using the initial condition. Then we substitute the values 
of the coefficients a, 41, 24, аҙ, . . . into series (6). 
Example 4. Using the method of undetermined coefficients, 
find a solution of the differential equation у’ = z? + у? which 
would satisfy the initial condition 20 = 0, y (zy) = 1. 
A Since zy — 0, series (6) assumes the form 
y = a, | аут + азл? + ам + axi 4-0... (*) 
Substituting z = z and y (хо) = 1 into relation (+), we get ау = 1). 
For what follows, it is convenient to expand tho right-hand side 
of tho equation y’ == z? -+ y? in the powers of (y — 1): 
y =z + у 0) HA -=ar 142(y—1-(—10?. (өз) 
Differentiating series (ж), we have 
y' = a, + 2a;z -+ Заз? + Аа? d3- .... (+++) 
We substitute now the expression for у’ from relation («#+), the 
expression for y [rom relation (+) and а, = 1 into relation (+x). 
Тһеп we obtain 
аз -F 24,2 -г vay? + áa,z2 p...— 44+ 27 + 2 (ағ + а, х? 
4- age? + at +...) + (аул + аз? + азу? +... .)?. 
We remove brackets on the right-hand side of tho last relation, col- 
lect terms and cquate the coefficients in the like powers of z. As 
a result we have 
a, —1, 2a; —2a,, Заз== 1 |-2ag-- ai, да, = 223 4-2а14:, 
whence we have a, = 4, a4 = 1, аҙ = 4/3, a, — 1/6. 


2 : 
Substituting the values of the coefficients we have found into 
series (*), we finally obtain 


у-і--г-- {г Та e. 
Example 5. l'ind a solution of the differential equation у” — 
z?y = 0 which would satisfy the initial conditions г, = 0, y (zy) = 


1, y (zo) = 0. А : 
A Since тұ = 0, wo shall seek tho solution in the form of a se- 


ries 
у = а + az + agz?+...+ аһ" +.... (*) 
Differentiating twice relation (*), we have 
y = ay + 2agz + 2agz? + Аад? +... + nage, (е) 


" 


y" = 2а, + баз: + 12az? +... + ann (п — 1) 27-2, (vee) 
Using the initial conditions, we find, from relations (+) and («е»), 
that a, = 1 and a, = 0. Substituting the values of the coefficients 
we have found into series (ж), we get 
y = 1 + а? + ayr? + azt t... H apt”. o (e) 
28-0104 
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To find the other coefficients of series (вө%е), we substitute the 
expression for y" from relation («e«) and that for y from rela- 
tion («««») into the given differential equation: 
24, -+ баз: + 124,27 + 20а,23 + 30a,z* + .. .+n (n—1)a,2"-3 
— 1° (1 + а, + аз? + azt tH... Hanz” +...) = 0. 
Grouping terms with the same powers, we have 
2a, + базт + (12a, — 1) т? + (20a,) 23 
+ (3006 — a4) zt + (420; — аз) 35 +... = 0. 
The relation obtained is an identity. Since we seek a solution for 
z - 0, it remains to set all coefficients in the powers of т equal 
to ето, i. e. 
а, = 0, а; = 0, 12a, — 1 = 0, whence a, = 1/12, 
а, = 0, 30a, — a, = 0, whence a, = 0, and so on. 
The solution sought has the form 


—44 dla ds 
y=1i+ 12% +57 2 Б... А 


9.4. Numerical Integration of Differential Equations. 
Euler's Method 


To solve ra differential equation of type у’ = f (г, y) 
by a numetical method is to find, for a given sequenco 
of argumengs zy, 21, . . ., 2, and the number yo, without 
determining the function y = F (г), the values уу, ys, . -"., 
y, such that у = F (у) (i=1, 2,..., n) and 
F (29) = Yo. 

Thus numerical methods make it possible, rather than 
finding the function y = F (г), to get a table of values 
of that function for a given sequence of the values of the 
arguments. The quantity h = xr, — Irkı is the step of 
integration. 

Let us consider some of the numerical methods. 

Euler’s method. This method is rather rough and is 
usually used for approximate calculations. However, 
the ideas that are at the base of Euler’s method serve 
as starting points for other methods. 

Consider a first-order differential equation 


y' =f (z, у) (1) 
with them initial condition 
ї = Zo, Y (20) = Yo (2) 
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We have to find a solution of equation (1) on the interval 
a, bl. 

We divide the interval (а, b] into п equal parts and 
get a sequence To, rj, Tg, ..., Xp, Where 2; = х, + 
ih (i —0, 1, 2, ..., n) and А = (b —ayn is the 
step of integration. 

We choose the Ath subinterval [r,, z, 44] and integrate 
equalion (1): 


Fhar ЫЗ “het 
| f(z de= È y'dz=y(z) | 
Th хь хь 


= y (zy) — Y (Th) = ук+ уһ, 


іі 
а-а) f(a у) da. (3) 
XR 
If in the last integral we assume the integrand function 


to be constant on the interval [r,, =һ+1] and equal to 
the initial value at the point z = r4, then we obtain 


That Shel 
{ Қа, dz fs y) 
Th Xh 


— f (Ens уһ) (Trt — 24) — ya^. 


'Then formula (3) assumes the form 


Yoti = Ул + Yah. (3) 
Designating Ур, — уһ = Aya, i.e. yah = Ayn, we get 
Yra = Yn + Aya- (4) 


Continuing this process and assuming every time the 
integrand function to be constant on the corresponding 
subinterval and equal to its value at the initial point 
of the subinterval, we get a table of solutions of the 
differential equation on the given interval [a, 5]. 

In terms of geometry, Euler's method consists in the 
following. On the interval [r,, ту] the integral curve is 
replaced by a segment of a tangent to it passing through 


28* 
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the point М, (zy, Yo). AS can be seen from Fig. 9.2, the 
slope of this tangent is 
tan % = (yy — yol(zy — T0) = f (£o Yo) = V' (те), 


Then a new segment of the tangent is drawn from the 
point М, (ту, yı) to the integral curve which passes 
through this point. The slope of this tangent is 


tan а = (уз — Y1) (£2 — д) = f (жу, и). 


Continuing the construction of such segmenls, we gel 
Eule: "8 broken line. This line passes through the given 
point M, (zy, Yo) and approximates the required inte- 
gral curve. 

If in a certain rectangle 


R (Ir — zo |S a, ly — Yy I b} 
the function f (z, y) satisfies the condition 
|/ (a, и) — Í (ns у) ISN IM — y | 


(N — const) (5) 
and, in addition, 
ч 91. +1$- < M (M = const), (6) 
then we have the following estimate of the error: 
ly (2x) — Jl < By (A AN)" — 11, (7) 


where у (zn) is the value of the exact solution of equa- 
tion (1) for z = r, and y, is an approximate value ob- 
tained at the nth step. 

Formula (7) is mainly used in theoretical calculations. 
In practice use is usually made of "duplication check". 
First the calculation is carried out with the stepsize A 
and then the step is divided and the calculation is re- 
peated with the stepsize h/2. The error of the more exact 
value y* is estimated by the formula 


lyn —y (tn) [2 lyn — Yn l- (8) 


Example 1. Use Euler's method to integrate, on the inter- 
val |0, 1.5], the differential equation y’ = y — т which satisfies 
the initial condition zy = 0, y, = 1.5; the step ^ = 0.25, Carry 
out the calculations with four decimal digits. 
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А To make the calculations more convenient, we compile 
a table. 


Table 9.2 

1 | хі | V, | v= ищ | Ay; = hvi 
wm | co | o | "m | (5) 

0 0 1.5000 1.5000 0.3750 

4 0.25 1.8750 1.8250 0.4082 

2 0.50 2.2812 1.7812 0.4453 

3 0:75 2.7285 1.9785 0.4941 

4 4.00 3.2208 2.2206 0.5552 

5 1.25 3.7158 2.5258 0.6314 

6 1.50 224702 


186 step. Using the initial data, we fill in the first row іп col- 
umns (2) an] (t 

2nd step. From the equation у; = y, — г, we find y; (i = 0, 
1,..., 9) in column (4). 





/ 
/ Mo (xs Y2) 


Fig. 9.2 


3rd step. We multiply tho contents of column (4) by h (we cal- 
culate Ay; = hy;, i = 0, 1, ..., 5) and write the result in col- 
umn (5) of the same row. 

4th step. To the contents of column (3) we add the contents of 
column (5) of the same row (we calculate yj, = yj + Ду, і = 0, 
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1, ..., 5) and write the result in column (3) of the next row. We 
determine z,,, = z; + h and then repeat steps 2, 3, and 4 until 
we cover the whole interval [0, 1.5]. A 


Euler's method can be used to solve systems of dilfer- 
ential equations and higher-order differential equations. 
However, in the last case the differential equations must 
be reduced to a system of first-order differential equations. 

Consider a system of two first-order equations 


у= (2, у, 2), 9 
{y= (т, y 2) ) 

with the initial conditions 
y (2) = Yo 2 (Zo) = Zo (10) 


The approximate values y (z,) & y; and z (z;) = 2; can 
be found from the formulas 


Уі = Yi + Ау), Zia = 2 + А2), (11) 
where 
Ay, = hf, (xi, yi, 21) Аз = А), (zi, Yi, zi) 
(i = 0,1,2,...). (12) 


Example 2. Using Euler's method, find a numerical solution of 


the system of diflérential equations H = (@—у)х with thc ini- 
е Syste 1 2' == (2--у) т 
tial conditions y (0) = 1.0000, 2 (0) = 1.0000 оп the interval 
[0, 0.6]; the step h = 0.1. Carry out the calculations with one 
ехіга digit. 
А To carry out he calculations, we use Table 9.3. The sequence 
of actions is clear from the table. A 


Table 9.3 





, 


у= (,-у)х) 














Ад = ща) 9 (no Gi yp azi = zh 











0 
0.0200 
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Example 3. Using Euler's method, compile a table of values of 
the solution of the differential equation y" + p + y = 0 on the 


interval |1. 1.5] for the initial conditions y (1) = 0.77, у (1) = 
— 0.44; the step А = 0.1. 

A By means of the substitution y’ = z, y" = z' we replace the 
given equation by a system of equations 


y'—t, 
2 = 2—0 


or the initial conditions y (1) = 0.77, z (1) = — 0.44. We carry 
out the calculations with one extra digit. To make tho calculations 
more convenient, we use Table 9.4. A 








Table 9.4 
| to 24 
|| 0% | úa (ansa) a PET xp| An zh 
-u 
І 

01 1.0 |077 | —0.44 | —0.044 | —0.44 | —0.33 | —0.033 
4f 1.1 |0.726| —0.473 | —0.047 | —0.473 | -0.296 | —0.030 
2| 1.2 10.679 | —0.503 | —0.050 | —0.503 | —0.260 | —0.026 
3| 1.3 |0.529| --0.529 | —0.053 | —0.529 | —0.222 | —0.022 
4| 1.4 |0.576| -0.551 | —0.055 | —0.551 | —0.183 | —0.018 
5| 1.5 |0.521 — 0.569 


9.5. Modifications of Euler's Method 


Improved Euler’s method. Consider a differential equa- 


tion 

у = f (г, у) (4) 
with the initial condition 

y (x) = Yo (2) 


ive have to find a solution of equation (1) on the interval 
a, b]. 

We divide the interval (а, b] into п equal parts by 
the points т, = rg + ih (i = 0, 1, 2,..., n), where 
h — (b — a)/n is the step of integration. The gist of the 
improved Euler's method is in the following. We first 
find auxiliary values of the required cunction y,4,/s at 
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the points z;41/4 = z, + + using tho formula 


h , 
Vies = Vi y Je (3) 


then find the value of the right-hand side of equation 
(1) atthe midpoint Уі) = f (Cities Yi+1ı/2) and deter- 
mine 

Via = Yi + Mtae (4) 


Remark. We can get the estimate of the error at the 
point z, by means of the "duplication check": we repeat 
the calculation with the step /А/2 and approximately 
estimate the error of the more exact value y? (for the 
step h/2) as follows: 


1 Г, 
lyi — y (zi) = 5 lyi—yil, (5) 


where y (z) is tho exact solution of the differential equa- 
tion, This method of Euler is more accurate as compared 
to the method discussed in 9.4. 


Example 1. Use Euler'simproved method to integrate the differ- 
ential equation y’ = y — z for the initial conditions х, = 0, 
Yo = 1.5 on the interval [0, 1] assuming k = 0.25. Carry out the 
calculations with four decimal digits. 

A We write the results of calculations in Table 9.5 which is 
compiled as follows. 





Table 9.5 

€* т È 
F a" le a АК E TR a 
= - |= ха срср 
I > +, | eels) ЗЧ 7, 

- a = : г х Sia 

« | (2) | (3) 

010 1.5000 

4 | 0.25 | 1.8906 

2 | 0.50 | 2.3208 

3 | 0.75 | 2.7892 

4 | 1.00 | 3.3345 

5 1% 3.9558 

6 | 1. 4.6856 
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ist step. Using the initial data, we fill in the fist row in col- 
umns (2) and (3). 

2nd step. From the equation yi — f (rj. yi) = yy — т we find yi 
for column (4) (i = 0, 1, ..., 5). 

3rd step. Wo multiply the contents of column (4) by А/2 and thus 
determine (5/2) yj and then write the result in column (5). 

Ath step. We get the contents of column (8) by summing up the 
value of z; from column (2) and 4/2. 

5th step. We sum up the contents of column (3) with that of 
column (5) and write the result in column (7). 

6th step. We substitute the values zj,;,/, Yi+ı/a obtained 
[columns (6) and (7)] into the right-hand side of the given differen- 
tial equation, determine АРГ: and write the result in column (8). 

7th step. We multiply the contents of column (8) by the step of 
integration & and determino hy, 42 [column (9)]. 

8th step. We add the contents of column (3) to that of column 
(9) and write the result у; = y; + Ау 453 (1 = 0,1,...,5) 
in column (3) of the next row. 

Then we repeat the wholo calculation process beginning with 
the second step. A 


The improved Euler-Cauchy method. The gist of this 
method is the following. We first find an auxiliary quan- 
tity 


Yiri = i Pss (6) 


then calculate y/,, == f (i+ yi) and find the required 
solution using the formula 


шуы = yu 4 h ECC MER . (7) 
Тһе estimate of the error can be found from formula 
(5) after a repeated calculation with the stepsize k/2. 


Example 2. Using the improved Euler-Cauchy method, integrate 
the differential equation from Example 1. 

A Tho results of calculations are given in Table 9.6. The table 
is filled in as follows. 

ist step. Using. tho initial data, we fill in the first row in col- 
umns (2) and (3). 

2nd step. We determine the valuc of уҙ = f (zi, yi) = yi — 24 
(f= 0,1,..., 5) for column (4). 

3rd step. We multiply the value of у, from column (4) by the 
step of integration A and write the result in column (5). 

4thstep. We find zi, = 7, + h(i = 0,1... ., 5) forcolumn (6). 

5th step. We sum up the contents of column (3) with that 
of column (5) and write the result in column (7), i.e. find 


Vier = yi t Ay}. 
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Table 9.6 
т - 
ые a “+ 
Ё А tS 
- = N 
- * 1% + 
н шаа 2 
т | 1 - |^ 
i а - ч + І 
m | awe | С E 3| [IG > 
> 3 = a 1” 1” із 4 


1.5000| 1.5000] 0.3759) 0.25 | 1.8750] 1.625 | 0.4062) 0.3906 
1.896] 1.6406] 0.4102] 0.50 | 2.3008) 1.8008 0.4502) 0.4302 
2.3208| 1.8208| 0.4552) 0.75 | 2.7760) 2.0260) 0.5065) 0.4808 
2.8016| 2.0516] 0.5129| 1.00 | 3.3145| 2.3145| 0.5786] 0.5458 
3.3474| 2.3474 0.5868| 1.25 | 3.9342} 2.6842] 0.6710] 0.6289 
3.9763| 2.7263| 0.6816| 1.50 | 4.6579| 3.1579| 0.7895| 0.7355 


4.7118 





6th step. We substitute the values of ғ) and y;,, we have 
found into tho right-hand side of the given differential equation 


and find yi, for column (8). 
7th step. We multiply the result of column (8) by the step of 


integration h and find Лу, [column (9)]. 

8Lh step. We find Ay; column (10) for which purpose we find the 
half-sum of the quantities written in columns (5) and (9). 

9th step. We sum up the contents of column (3) with that of 
column (10) and write the result in column (3) of the next row, i.e. 
determine уь = у; + Ау). 

Then we repeat the whole calculation process beginning with 
the second step. A 


The improved Euler-Cauchy method with successive 
iterative computations. This method is more accurate 
than the Euler-Cauchy method discussed earlier. The 
gist of this method is that every value of y; obtained is 
subjected to iterative computations. We first find a 
rough approximation 


Vias Yi thi (zs ш) (8) 


and then construct an iterative process 


y iyi fos yd fes vit). 09) 
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We continue the iterative calculations until two suc- 
cessive approximations yf? and yt) coincide in the cal- 
culation digits in question. Then we assume that y,4, & 


уЗ. If, after three or four iterations, the digits do 
not coincide for the chosen value of k, we reduce the cal- 
culation step k. 


A Example 3. Using the method of iterative computation, find, 
with the accuracy to within four coincident decimal digits, a solu- 
tion of the equation у’ = y — у for the initial conditions y (0) = 
1. Obtain the solution Y the interval (0, 1.5] take Л — 0.25. 

A From formula (8) we find that 


yi = yo F А (yg — 20) = 1.5000 -|- 0.375 = 1.8750. 
Next, using the погаш process (9), we find, in succession, 
"еміз È [(u9— 20) + (1 — ту)] 
= 4.5000 40.425 (1.50000 + 1.875 — 0.25) = 1.89062, 


yP =y 1 2 (о) +U — 29] 
=1 uu 0.125 (1.5000 4- 1.89062 — (1.25) = 1.89258, 


VP = 2 1000—20) + (i? — 21)] 
= 1-5000 F0. 125 (1.5070 + 1.89258 — 0.25) = 1.89282, 

у= T [(yo — ту) + (yt? — 21)] 
= 1.5000 4- 0.125 (1.5000 + 1.89282 — 0.25) = 1.89285. 


In the last two approximations four digits coincide. Therefore, 
after rounding off, we can assume y, = 1.8929. 
Again using formula (8), for i = 1, we find that 
wo = yi F hj (тү, уу) = y thy — 2) 
= 1.8929 + 0.25 (1.8929 — 0.25) = 2.3036. 
From formula (9) we find the successive approximations: 
УФ = 1,8929 + 0.125 [1.6429 + (2.3036 — 0.50)] = 2.3237, 
үн = 1.8929 + 0.125 [1.6429 + (2.3237 — 0.50)] = 2.32622, 
y§? = 1.8929 + 0.129 [1.6429 -+ (2.32622 — 0.50)] = 2.32654, 
ұя = 1.8929 + 0.125 [1.6429 + (2.32654 — 0.50)! = 2.32658. 


We can terminate the iterative calculations and assume y, c 
2.3266. Using then formulas (8) and (9), we get a solution of the 
' given equation. Tho results of the calculations are given іп 
Table 9.7. A 
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Table 9.7 
1 

NE d и, кў | у, 49, (n2 MIT 
010 1.5000) 1.875 | 4.89062) 1.89258, 1.89282 | 1.89285 | 1.8929 
1 | 0.25 | 1.8929| 2.3036 | 2.3237 | 2.32622) 2.32654 | 2.32658 | 2.3266 
2 | 0.50 | 2.3266) 2.78325| 2.80908, 2.81231 2.81271 | 2.81276 | 2.8128 
310.75 | 2.8128] 3.3285 | 3.36171] 3.36586 3.3664 | 3.36645 | 3.3664 
4| 4.00 | 3.3664! 3.9580 | 4.0007 | 4.00603) 4.0067 | 4.00679 | 4.0068 
5 1.25 2.0068 4.6960 | 4.7509 | 4.75776 4.75870 | 4.75872 | 4.7587 
у 1.50 | 4.7587 


9.6. The Runge-Kutta Method 


The Runge-Kulta mell:od is опе of the most accurate 
methods. It has much in common with Euler's method. 

Assume that on the interval (а, b] we have to find а 
numerical solution of the equation 


у = Í (z, у) (1) 
with the initial condition 
y (ғ) = Yo: (2) 


We divide the interval (а, b] into n equal parts by 
the points z; = Tọ + ih (i = 0, 1,..., п), where 
h = (b — а)/п is the step of integration. As in Euler's 
method, in the Runge-Kutta method the successive 
values y; of the required function y can be found from 
the formula 


Viri = Yi + Ду. (3) 


If we expand the function y іп a Taylor's series and 
restrict the calculations to À* inclusive, then we can rce- 
present the increment of the function Ay in the form 


Ay=y(z+h)— нен (х)+ 5 Ly (a+ È >y" (2) 
T UU (2), (4) 


b 
where the derivatives y" (х), y” (x), y!V (г) can be found 
from equation (1) by a successive differentiation. 
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Instead of direct calculations with the use of formula 
(4), in the Runge-Kutta method we find four numbers: 


ky=hf (т, у), 
ks hf (zy), 


D k 
ky=hj (+3, ut), (5) 

к. = hf (x - h, y+ k). 
We can prove that if we assign the weights 1/6, 1/3 
1/3, 1/6 to the numbers k,, /c,, Ёз, k, respectively, then 


with an accuracy to within the fourth powers, the weighted 
mean of these numbers, i.e. 


1 1 1 1 
тела ktg fuk (6) 
is equal to the value of Ay calculated from formula (4) 
1 
Ay =- (k, -1- 2kg + 21, + К). (7) 


Thus, for every pair of values of т, and y; from columns 
2 and 3 we find tlie values of 


KP = hf т, у), 
, д 
KP Sa (no ә 4), (8) 








i h ii 
MP hf (xd win) 


KD — hj (ti th, yi Юр), 
from formulas (5) aud, using formula (7), we determine 
1 
Ay, = > (KP 4-28? 4- 265) + HY) 
and then 
уц = Yi + Ау. 
The numbers Ау, К;, kj, k, have a simple geometric 
meaning. Let the curve M,CM, (Fig. 9.3) be a solution 
of the differential equation (1) with the initial condi- 


tion (2). The point C of this curve lies on a straight line 
which is parallel to the y-axis and bicects the interval 
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(1), 21-11 and B and С are the points of intersection of 
the tangent drawn to the curve at the point M, and the 
ordinates AC and N,M,. Then, with an accuracy to 
within the factor k (where № = 2,4 --2)), the number 
k, is the slope of the tangent at the point My, to the in- 
tegral curve МСМ}, і.е. kı = hy, = hf (zi, yi). 


The point В has coordinates z= =, + +, уу 


-h. and, consequently, with an accuracy to within the 


y 





Fig. 9.3 


factor h, the number /, is the slope of the tangent drawn 
to the integfal curve at the point B (BF is a segment of 
this tangent). 

Through the point M, we draw a straight line parallel 
to the segment BF. Then the point D has coordinates 


z = zi + 5, y = ш + 2 and k, with an accuracy to 


within the factor k which is the slope of the tangent 
drawn to the integral curve at the point D (DR, is a 
segment of this tangent). Finally, through the point 
М, we draw a straight line, parallel to DR,, which cuts 
the extension of V,M, at the point Hg (т, + А, y, + Ез). 
Then, with an accuracy to within the factor h, k, is the 
slope of the tangent drawn to the integral curve at the 
oint j. 
P It is convenient to use the scheme shown in Table 9.8 
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to make calculations by the Hunge-Kutta method. This 
table is filled in as follows. 
ist step. In columns (2) and (3) of the running row 








Table 9.8 
a 
a 
i x y =) (х, y) = Ay 
І 
H E 
ol eo | @ | (4) |o] @ 
| 
Tg Yu P Yo) кө ке 
h ky” к 
0 тт Yo- psr (в1- d > Во =) қы ГАД 
h ko» "n 
no о (ata nH) ңә | ie 
Zo +h ҮС Í (zo- h, у +89) кұ» к 
i ——MMM 
(1 
6 
= А yo 
zi и == уд Í (ti, и) к кө 
--Ауо 
h ке h кө 
1 nig Yvi E (2, Tu nd) kj? 2000 
1) 
Nm + f(x 97: Ji AX ) ky» 2j," 
zich [ntk] fth ES) |қ) Ао 
1 
6 
= Ау; 
2 та уз — V1 
+4y, 














we write the values of z and y we need. (If it is the first 
row, then we write the initial data, т, and y,.) 
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2nd step. We substitute the values of r and y of the 
running row into the right-hand side of the differential 
equation (1), find f (z, y) and write the result in column (4) 
of the same row. 

3rd step. We multiply the value of f (г, y) of column 
(4) we have obtained by the slep of integration h, calcu- 
late k = hf (x, y) and write the result in column (5) of 
the same row. 

4th slep. We multiply the values of Ж obtained by the 
appropriate coefficient (by 1 if the value is A, ог k, or by 
2 if it is kg or k) and write the result in column (6) of 
the running row. 

We repeat steps 1, 2, 3 and 4 to find every А in the ith 
solution. 

We sum up the results of the sixth column, divide by 


6 and find Ay; = 1 У and у+ = yi + Аш. 


Then we repeat all the calculations beginning with tlie 
first step until we cover the whole interval (а, 01. 

The Runge-Kutta method has the order of accuracy 
h* throughoüt the interval [a, b]. It is very difficult 
to estimate the accuracy of this method. We сап get a 
rough estimate of the error by means of the "duplication 
check" from the formula 


» 
lyt —y (21) = A (9) 
where у (т) is the value of tlie exact solution of equation 
(1) at the point z; and yf and y, are approximate values 
obtained with the steps ^/2 and h 
If & is the preassigned accuracy of the solution, then 
the number n (the number of partitions) for determining 
the step of integration 4 = (b — a)/n is chosen such that 
ҺА < е. (10) 
However, we can change the step of calculations when 
we pass from one point to another. 
We can estimate the correctness of the choice of the 
step h using the relation 
PONO | 


I=) O_O 
where 4 rffust be equal to several hundredths, otherwise we 
must reduce the stepsize k. 


(11) 
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Example 1. Given a differential equation y’ = y — т satis- 
fying the initial condition y (0) — 1.5, find, with an accuracy of 0.01 
a solution of this equation for = = 1.5. Use the Runge-Kutta meth- 
od and make calculations with two extra digits. 


A We choose the initial step of calculations h from the condi- 
tion kê < 0.01. Then л «0.3. To make the calculations more con- 
venient, wo assume that h — 0.25. We divide the whole integration 
interval |0, 1.5] into six equal parts by the points т; = 0, т) —0.25, 
т, = 0.50, zy = 0.75, т, = 1.00, г, = 1.25, т, = 1.50. From the 
initial conditions we һауе г, = 0, yy — 1.5. We seek the first approx- 
imation y, + Ayo, where 

Ava — (EP + 2449 + 2149 + 9). 
Using formulas (8), we obtain 
K(9) == (yg — To) k = 1.5000.0.25 = 0,3750, 


(0) 

м [ (vo +) -- (^ +4) |р 
= [(1.5000 ++ 0.1875) — 0,125] -0.25 = 0.3906, 

] 

kg À 
мо | (n+ E) — (5) ]^ 
= [1.5000 + 0.1953) — 0.125] -0.25 = 0.3920. 
М9 -- [о MP — (y РАА 
= [(4.5000 + 0.3926) — 0.25] -0.25 -= 0.4100. 
Consequently, 
A= t (0.3750 -]- 2.0.3900 + 2- 0.3926 + 0.4106) — (1.3920), 
уу = 4.5000 -1- 0.3920 = 1.8920. 


One сап soe from Tablo 9.9 how to go on with the solution of the 
equation. Thus the final result is y (1.5) = 4.74. A 


The Runge-Kutta method can be employed in the 
solution of systems of differential equations. 
Consider a system of first-order differential equations 


[yal у, 2), 
z'—g(x, y, 2) 
with the initial conditions 

T = To Y (га) = Yo 2 (г) = 20. (13) 
In this case we determine the numbers Ay; and Az;: 


Ay; =E (49 E AP 4 24 P, 


(12) 


1 a) (4) (4) #) (14) 
Az, =- (Ñ -- 21 + 2 + D, 


28—0104 
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а» | ә | wv 


о |0 1.5000 
0.125| 1.6875 
0.125] 1.6953 
0.25 | 4.8926 


1 0.25 1.892) 


0.375 2.0973 
0.315 2.1073 
0.50 2.3251 





v’ = f (x, v 


(4) 


1.5000 
1.5625 
1.5703 
1.6426 


1.6420 
1.7223 
1.7323 
1.8251 





h = M (x, у) 


(5) 


0.3750 
0.3906 
0.3926 
0.4106 


0.4105 
0.4306 
0.4331 
0.4562 





Table 9.9 


Ay 


(8) 


0.3750 
0.7812 
0.7852 
0.4106 


|| | 


2 0.50 2.2343 
0.625 2.5523 
0.625 2.56052 
0.75 2 8093 


1.8243 
1.9273 
1.9402 
2.0593 


0.4561 
0.4818 
0.4850 
0.5148 





3 |0.5 2.8084 2.0584 0.5146 0.5146 
0.875| 3.0657 2.1907 0.9477 1.0954 

0.875] 3.0823 2.2073 0.5518 1.1036 

1.00 3.3602 2.3602 0.5900 0.5900 
121 | osse 

4 1.00 3.3590 2.3590 0.5898 0.5898 
1.125| 3.6539 2.5289 0.0322 1.2041 

1.125| 3.6754 2.5501 0.6375 1.2750 

1.25 3.9965 2.7465 0.6686 0.6866 

—— t 


0.6360 
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Table 9.9 (continued) 


k = hf (x, y) Ay 


у’ = f(x, 1) 




















where 
кч) = hf (zi, Yiy 2), 
KD — Ag «i, Un ч, 


(1) 
kP == hf (zi +> 4 И nt 21+ —- a 





IS? — hg (ғ 4- T ut, d 
P -= hf (т; +4 tat T NL ag. 
Д? -= hg (т uc ңө, 





MD -= hf (ath, ytkD, z MM 
49 hg (2: +h, yt k, n SD). 
Then we gel a solution of the system 
Vini = Yi t Ау, Zia = 2 + Ай. 
Example 2. Given a system of differential equations 
| 2y—r 
2 
24 
1+2 


with the initial conditions OS == 0.5, yg = 1, zo, — 1, find a solution 
of the system for z — 0.6. Make calculations with five decimal 


digits. 
29* 
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A We choose a step k = 0.1 and find the numbers kj, |, kg, ly, 
ks, lg, Ка М: 








E T — 0.15000, 
2yo _ 2 
th 0.5 7019338, 
apee (mr) (5+2 2) —0,4.2:1.075—0.55 4100 
CMT 1406007 7 777 
s 
Yo (n) 2.4015 
=0 4 LLL 0.13299 
1.06667 0.55 , 
"кїч )+ (2+5 3 2) + 
er (6) (12) 2 ) 
4 
2-4 .07050— o. 55 
—04.— 066859 —— 714918, 
l= aeta) _ -- 0,1 2.1.07050 —0.13245 
кү” ^ 1.06650.-0.55 "^" 
irm )* (2-5) + 
= Ziutka] 2-4 .14918—0.16 | 
Ke =l z Fis 204. Uum = 0.14998, 
2 (vot Мм) 21.149448 _ 
aye |= 04-1 43245-F0.6 — 0719200, 
consequat, 


A (0.45 -+2-0.14400-4-2-0.14918-+ 0.14998) = 0.14072, 


As, = 1 (0.13333 + 2-0.13299 4- 2.0.13245 ]-0.13266) = 0.13281 


and we get the value of the required functions at the point z — 0.6: 
yy = 1 + 0.14672 = 1.14672, z, = 1 + 0.13281 = 1.13281. A 


9.7. Adams' Extrapolation Method 


When, using the Runge-Kutta method to solve a dif- 
ferential equation, it is necessary to carry out numerous 
calculations to find every y,. In the case when the right- 
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hand side of an equation includes a complicated analytic 
expression, the solution of the equation by means of the 
Runge-Kutta method is very laborious. Therefore, in 
practical computations, Adams' method is usually used 
which does not require repeated calculations of the 
right-hand side of the equation. 

Consider a differential equation 


y' =f (т, у) (1) 

with the initial condition 
ж = То, у (£o) = Yo- (2) 
We have to find a solution of this equation on the interval 


la, bl. 

We divide the interval (а, b] into л equal parts by 
the points z; =z, + ih (i =0, 1, 2, ..., п). We choose 
a subinterval [r;, 2;4,] and integrate the differential 
equation (1). Then we get 


Yin = Yit | y' dz, (3) 
or 


Ay; = ) y' dz. 


To find the derivative, we use Newton's second inter- 
polation formula (restricting our computations to third- 
order differences): 





у= thy HEEE tyi s 
ЕТТТ "m (4) 
where (= (0—20) ог 
Yi-2 
Nm A3yi. 3. (4) 


Substituting the expression for y' from formula (4) into 
relation (3) and taking into account that dr = h dt, 
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we have 





1 
2 
Ay, =h | (uit this ++ 5, A*yi-» 
0 
9 a y 
+++ ду; s) dt 


= hyi-+ $A (yii) + py A? (Буз) + 2 A (ui sa). 
(5) 


In what follows, we designate 
q, = yah = f (zi, yi) h (і = 0,1, 2, 5. ., n). 


Then, for any difference, we have А”; = A" (y;h) and 
1 5 3 А 
Ау = + x Айа аі Aq + g ^49 (6) 


From the formula y,4, = yi + Ay, we get a solution of 
the equation. Formula (6) is known as Adams' eztrapola- 
tion formula. 

To begin the computation process, we need four initial 
values Yo, Ji, Уз, Уз constituting the so-called initial 
interval which can be found from the initial condition (2) 
with the use of one of the familiar methods. The initial 
interval of the solution is usually obtained by means 
of the Runge-Kutta method. 

Knowing Yo, yi, Ye: Уз, We can determine 


Чо = hy, = hf (zo Yo); dy = hyi = hf (тү, Y1), 
qe = hy, = hf (г, Ya); 4з = hys = hf (тәу ys). (7) 


Then we compile a table of differences involving the quan- 
tity q (Table 9.10). 

Adams' method consists in extending the diagonal 
table of differences with the use of formula (6). By means 
of the numbers gs, Ags, А741, A?q,, which cross the table 
along the diagonal, we find from formula (6), setting 
n — 3 in it (the last known value of y is y;), that 


* 1 5 a2 3 Ag 
Ays — 9 + > Aga + ч» ô ЕД + 5А 4: 
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Table 9.10 
i | s v | ^" Я уа = №] 59 | 4%, | Atay 
оо (о[о | ө [оро [о [о 
0 | To | Yo | | Í (20, Yo) | do | Aq | A?g, | A? qe 
[а [а | [few | a | ^n ае | 
2 | 1а | уз | | (аа, уз) | Яз | Адз | | 
3 | тз | Уз | Aya | Гау уз) | 93 | | | 
‘fatal | | | [|| 
sjal] | | | | | | 
ба| [| | | | d || 


We tabulate the value of Ay, апа find y, = уз + Луз. 
Then, using z, and the value of y, we have found, we 
determine f (Zis Ya) qu А4:, А74;, A?q,, i.c. we get a 
new diagonal. From these data we obtain 


1 5 3 
Ay, = qa + - Аф 45 Ағ%4; Tu А, Js = Yat Ад. 


We thus continue with the table of solution calculat- 
ing the right-hand side of the differential equation (1) 
once at each stage. 

We can also use Runge's principle to make a rough 
estimate of the error. It consists in the following: 

(1) we find a solution of the differential equation for 
the step h, 

(2) next we double tho value of the step k and find the 
solution for the step H = 2h, 

(3) and then we calculate the error of the method from 
the formula 


Е = Wa ae | , (8) 
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where y, is the value of the approximate calculation 


for the double step H = 2h and y,, is the value of the 
approximate calculation for the step h. 

Remark. When calculating with the step h, we assume 
that we have an error proportional to h™+! at every step 
and with the step 2h we bave an error proportional to 
(2h)n*! if the order of accuracy of the method is defined 
and equal to h™. 

Note that in Adams' extrapolation formula (6) the third 
finite differences A?q are assumed to be constant. There- 
fore we can find the value h of the initial step of calcu- 
lations from the inequality h4 < e, where e is tlic preas- 
signed accuracy of the solution. 

In practical calculations we usually watch the course of 
the third finite differences choosing h such that the ad- 
joining differences А%4; and АЗ, should differ from 
each other by not more than опе or two unities of the 
specified decimal place (not counting the extra digits). 


Example 1. Use Adams' method to calculate, with an accuracy 
of 0.01, the value of the solution of tho differential equation y' — 
y — z for the initial т, = 0 and y, = 1.5 when z = 1.5. Carry 
out all calculations with two extra digits. 

A As before, we choose h from the relation h4 « 0.01, i.e. k = 
0.25. We take the initial interval yg, у, yo, Уз from tho solution of 
Example 1 in 9.6. To solve this equation, we compile two tables, 
the main Table 9.1t and the auxiliary Table 9.12. Their purpose 
is clear from the tables themselves. 

The final result is y (1.5) — 4.74. A 


Table 9.11 
yi q 
1 хі V, Ау; =f (х, E hy , Aq, А, Аза, 
ур = an 
о[о[ о |] | of] о о | ov 
о [о 1.5000 1.5000 | 0.3750] 0.0355 | 0.01017 0.0028 
1 0.25 | 1.8920 1.6420 | 0.4105| 0.0456 | 0.0129] 0.0037 
2 | 0.50 |2.3243 1.8243 | 0.4561] 0.0585 | 0.0166) 0.0047 
3 0.75 | 2.8084 | 0.5504! 2.0584 | 0.5146| 0.0751 | 0.0213 
4 1.00 | 3.3588 | 0.6356) 2.3588 | 0.5897) 0.0904 
5 | 1.25 |3.9944 | 0,7450) 2.7444 | 0,0801 
6 1.50 | 4.7394 
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Table 9.12 
i 8; | + Adi, d Аз); i Ая, | Au, 
3 | 0.5146 0.0293 0.0054 0.0011 0.5504 
4 | 0.5897 0.0376 0.0069 0.0014 0.6356 
5 | 0.6861 0.0482 0,0089 0.0018 0.7450 


Adams’ method can also be used to solve systems of 
differential equations and nth-order differential equa- 
tions. 

Assume that we have a system of two equations 

7 (г, у, 2), 


z' — fa(z, y, 2). (3) 


Then Adams’ extrapolation formulas for this system have 
the form 


1 5 » 3 
Ayi == Pit u Ap; -1-H dy A?Pia t- F Api 3, 


s 3 (10) 
Az — Bi + Mia ag Аша Ao 
where 
р; = hyi -: hf, (zi, Yis 2,), 
E, = hzi = hfa (ta Yis zi) 
and 


Visi = Yi + Ау), 2:41 = Zi + Ағ). 


Example 2. Using Adams’ method, find a numerical solution 
of the system of differential equations 


у =(z—y) г. 

2' =(z-+-y)z 
for the initial conditions y (0) = 1.000, 2 (0) = 1.000 on the inter- 
val |0, 0.6], the step is Л = 0.1. 

A We take the initial interval of solution [rom Table 9.3 (earlier 
we used Euler's method to solve this system). We shall seek tho 
values of the functions y (г) and z (г) for z, = 0.4, z,— 0. 5 and 

- 0.6 using formulas (10) and designating f, (т, y, 2) -= y' = 
@ — y) z aud f, (£, y, 2) = z' = (2 J- у) 2. The calculations are 
given in Tables 9.13, 9.14, und 9.15 (Tables 9.14 and 9.15 are aux- 
iliary). 
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Table 9.13 


Азр, 
0.0006 
0.0010 
0.0004 

Ағ, 
0.0006 
0.0043 
0.0007 

Table 9.44 
Л 






































- ая - ERE КЕ 
= | 5282 7 | S352 z 
cece сссс 
E RE оо PIED 
г | 22288 - | 55585 
3 5555 % | 88858 г 
cccco оссссо 
со сс ч" o0 ез 
- | SEEEBE _ | 853254 
& 58555 E ёзен т 
оссссс сссессо 
a = о 4 oan г 
ccc ccc 
х | 32383338 | г | 3583834 г 
< «4 «ч чч чч чч ul ui 414 ч чч чч чч Че 
~ e CQ 6) st 90 | -. = C CD чмо 
came | | — -namneo - 
н сссоссссо н сссоссс н 
_ _ 
- е СЧ со чно СО - Cen C «P о О ~ 





| 








by; 


А'р 





tr {Pi 





Ар{-ү 


ES 
2 





0.0032 
0.0081 
0.0450 


0.000375 
0.00045 


0.000425 0.000225 
0.000850 
0.0010 


0.0007 
0.0017 
0.0029 


0.0048 
0.0052 
0.0180 


3 
4 
5 
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Table 9.15 (continued) 





1 3 
| 5 | Мы | А-а | F 55 | An 


0.0618 0.0107 0.000425 0.000225 0.0732 
0.0855 0.0118 0.000958 0.000488 0.0987 
0.1122 0.0134 0.00125 0.00026 1.1271 


е с 


Table 9.14 serves for determining the right-hand sides of this 
system and for finding p, and g;, and Table 9.15, for determining 
Ay, and Az, from tho differences of tho values of p and g obtained 
in Table 9.13. A 


9.8. Milne's Method 


As tho Runge-Kutta method, Milne's method is of high accu- 
гасу. 

Assume thay ‘vo have to find, on tho interval |а, b], a numerical 
solution of tho difforontial equation 


y = f(z, у) (1) 
with tho initial condition 
у (20) = Yor (2) 


We divide tho interval |а, b] into n equal parts by the points z; = 
Zo + ih (i = 0, 1, ..., n), where k = (b -- a)/n is the step of 
integration. 

Using tho initial data, we employ somo technique to find succes- 
sive values y, = y (zy), ya = y (22), уз = y (тз) of tho required 
function y (т). Thus we find y; (i = 0, 1, 2, 3 

Wo can find the approximation y, and y, for the successive 
values y, (i = 4,5, . . ., п) from Milne's formulas: 


> 4h , , , 
Vi — Ying tz (Qyi-3 — v -2 21-1), (3) 
We Fia e АИ а -2), (4) 
whero y; = f (21, у. - 
Wo can show that tho absoluto orror of the value y, is approxi- 
mately equal to 


uu lyi— yal. (5) 
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Therefore, if e; < е, where e is the preassigned limiting error of the 
solution, then we can set y; = y; and yi = f (Zi, yj). This occurs 


when y; and y; coincide at the decimal places of interest to us. If 
condition (5) is fulfilled, we pass to the calculation of the next value 
Фар repeating the process. Otherwise, beginning with a certain 
place, we reduce the stepsize h and recalculate the corresponding 
initia) interval. As in the Runge-Kutta method, the value of the 
initial step can be found from the inequality kê < е. 

To derive Milne’s formulas (3) and (4), we use the Newton’s 
first interpolation formula for the derivative y’ at a chosen point zy, 
and restrict our calculations to the third-order differences. This 
is equivalent to the approximation of the integral y = y(z) of the 
differen'ial equation (1) by а four-degree polynomial. We havo 


, , , —1 " —1 —2) , " 
y = jt yg TE ay, 280 0—2 мэ qu) 
Removing the brackets, we havo 

, , , 1 y , 1 4 s “ . 

y == уп E 48g, dy (4%— а) АЗУ, +e (4? — 34? + 20) Азур, (7) 


where q:—(z— тд)/һ. 
Setting k= i — 4 in relation (7), we obtain 
Qr , 1 , 
y'= yi-h -b gAyi~a + > (0* —9) Myi-4 








1 " L4 
by (9° — 34° + 2g) Nyi- (8) 
We integrate relation (8) with respect to z from z;_4 to ту 
х; Xi 
( , __ ° r ” 92—40 2, 
y de у4-4-1-4404-4------ Atyi-4 
"ig 54-4 
3.  9g3.1- , 
айша ы Jae 
Taking into account that = (z — z,-4)/h and dz = hdg, we have 
4 4 4 , 
7 : , 2s, , ( 4—4 
Vi — Yia =h A yi- V ФР Ayi-4 \ ada-E A*yi-4 2-44 
0 0 9 
4 
r ‹ 02 — 392-2 


0 


, , 20 8 , 
=h амали 5 Аза АИ). 09) 
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Since 
Ayi-4 201-38 — 01-0» 
Ayi- 4 == 1-2 —2yi-3-F- yi-a, 
AP yi 4 = yi, — 30-2 |- 301-3 — 01-4, 


we сап substitute these expressions into relation (9) and get 
Milne's first formula (3): 


- ал , , , 
Vi = o (294-3 — yi - 2--2yi- 1). 


To derive Milne's second formula (4), we set k — i — 2 in rela- 
tion (7): 


, Й , 1 , 
y 2101-24-400-2 T, (43-4) A?*yi-2 
' 1 , 
UNS (43 —-3q? 4-24) A3yi - ә. (10) 


where q = (т — zj 4)/h and dz = Ад. 
Wo integrate relation (10) with respect to z [rom ri- to 2): 
x 


i 
| y'dr-—h 
1- 


T t 


, , 1 o ^" 
(й-а-амі-а-- -y (92 — 9) Nyi-2 


с 


х 
1 J 2 3,4 
deg (9° — 30° -|- 2g) Азин 2] da. 
From this we have 
реа (2-22401-204-5, Atyi-2] . (11) 


Taking into account that Ayi-2-— yi-1— yi-2 and Ayi- = yi — 
2yi-1--yi-2» we get Milne's second formula (4): 


= h , , , 
yi — Vi-a > (yi4- Ayi-1 -- yi - 2). 


Example 1. Given a differential equation y’ = y — z satisfying 
the initial condition zy = 0, у (rj) == 1.5, calculate, with an 
accuracy of 0.01, the value of the solution of this equation for z — 
1.5. Carry out calculations by the combined Runge-Kutta and 
Milne's method with two extra digits. 

A We choose the initial step of calculations. From the condi- 
tion Аа < 0.01 we get k = 0.25. Then we can divide the whole 
integration interval into six equal parts by the points zr, = 0, 
ту = 0.25, т, = 0.50, г, = 0.75, z4 = 1.00, z, = 1.25, zy -— 1.50. 
We take the initial interval yo, yi, Y2, уз from the solution of Exam- 
ple 1 in 9.6. To solve this equation, we compile Table 9.16. 


-------------------------------------- SSS 


« € 807177 | «ОК ӘМ” | cures | СОЎУ 067 9 
« “ OGvL'C | 066676 8-0} 0666'€ | [9776 | 196676 sat} s 
Aressavau JON | 06662 | 066676 | «-0Ғ-2 | 06676 | gect'c 885676 00Р] * 


786076 | #8080 | SL'oj € 


ЕМІ, | ezez joroj € 


099% | ӨН | SC'OO | Т 


0008°1 | 000€] 0 9 















(s) Ix- ia. tz—la= 1=-м = 
€[nurigg Jo 3[nsaa | (d.d = ! 1д «1 = i Ja = 
egi VIA doj8 Jo са 2/4 ^a ta 1 Ca" es 1 et n м ы , 
uonje[n3[e3aI әң, И | м “ 
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Thus we get an answer: y (1.5) — 4.74. 
When solving a system of differential equations 
„=, у, 2), 
9 (z, y, 2) 
with the initial conditions y " = уо, 2 (zy) = zy, Milne's formulas 
are written separately for the nct y (z) and z (z). The order of 
calculations remains the same. 
Example 2. Given a system of equations 


y' = соз (y-- 1, 12) -1, 
2200043 , 
f; = т?й іт--1 


with the initial conditions y (0) — 3.14159, 2 (0) — 0. UseMilne's 
method to calculate, with an accuracy of e = 0.0001, the solution 


Table 9.17 
о] o | o | «qw e| e | o | we | we | e 
= (и 2) Yi 
A ЕСЕН ЕГЕН ЕСІНЕН Vi ^ А Vi | z4 
0 0.0 
1 0.1 
2| 02 
3| 0.3 
4| 04 3.16057 | 0.49906 | 0.15098 | 4.44678 
5| 0.5 3.18104 | 0.64870 | 0.27079 | 1.54596 
o [| @® $ [| aw an | аз 
Y, =Y; Ұ|-ү) “ 
p? | 4 Wu | 4=4 ei е.а 





3.14159 | 0.00000 | 0.00000 1.04824 

3.14184 | 0.10981 | 0.00732 1.14801 

3.14304 | 0.22960 | 0.03224 1.24773 

3.14903 | 0.35934 | 0.08001 1.34734 

3.16062 | 0.49905 | 0.15704 1.44078 |1.7.10-5 0 
3.18166 | 0.64869 7.107? | 4.10-7 
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of this system on the interval |0, 0.5] taking a step h = 0.1 and 
assuming the values of the functions y (z) and z (z) to be known for 
т = 0.1, т, = 0.2, =з = 0.3. These values aro y (0.1) = 3.14184, 
y (0.2) — : 8. 14364, y (0. 3) — 3.14903, z (0.1) = 0. 10981, 2 (0.2) — 
5. 22960, 2 (0.3) -- 0.35934. 
А We shall seek the values of the functions y (0.4), y (0.5) and 
z (0.4), z (0.5) from formulas (3)-(5). We carry out tho calculations 
with the aid of two tables: the main Table 9.17 and the auxiliary 
Table 9.18. 
Wo write the initial interval of the solution in columns (7) 


and (8) of Table 9.17 and find the valuos of y, and 24 [columns (9) 























Table 9.18 
4 5 
Vi | ЫП Vi | ЫП 

2Yi-3 0.01464 2.29602 0.06448 2.49546 
—Yi-a —0.30224 | —1.24773 | —0.08004 | —1.34734 
2Y1-1 0.46002 2.69468 0.31402 2.89356 
y | 0.14242 | 3.74297 0.29849 | 4.04168 
Àj YO 0.04898 | 0.49906 | 0.03980 | 0.53889 
Yia .3.14159 0.00000 0.14184 0.10984 
Yi l. 3.16057 | 0.49906 | 3.18164 | 0.64870 
Yi-2 0.03224 4.24773 0.08101 1.34734 
4Y% -1 0.32004 | 5.38936 0.62804 5.7871 
Yi 0.15698 1.44678 0.27079 1.54596 
y | 0.50926 | 8.08387 | 0.97884 | 8.68042 
3 y? 0.04698 0.26945 0.03263 0.28935 
Yia 3.14364 0.22960 3.14903 0.35934 
- r 
Yi | 3.16062 | 0.49905 | 3.18166 | 0.64809 
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and (10)]. Using then the data obtained and formula (3), we find 
y4 and z, (Table 9.18). _ _ 

We transfer the values of y, and 2, into the main table [columns 
(3) and (4)], determine y; and z4 [columns (5) and (6) of Table 9.17] 
and then, using again the auxiliary table, we find y, and z,. We 


transfer their values into columns (7) and (8) of Table 9.17. We 
find that 


1 = - 1 = - 
еы = 35 (Ya— Ya) Шат 39 (z4 — 24) 
[columns (11) and (12) of Table 9.17]. For the preassigned permissi- 
ble error e — 0.0001 we see that we can omit the recalculation of 


the initial interval and take y, as y,. To find y (0.5) and 2 (0.5), we 
repeat the whole process of calculation. 

The final result is y (0.4) — 3.16002, z (0.4) — 0.49905, y (0.5) — 
3.18166, z (0.5) = 0.64869. A 


9.9. The Notion of the Boundary-Value Problem 
for Ordinary Differential Equations 


We use the -vample of а second-order equation 


F (z, у, y, y^) -- 0 (1) 
to discuss the solution of the boundary-value problem for 
ordinary differential equations. 

The simplest two-point boundary-value problem for 
equation (1) is posed as follows: we have to find the func- 
tion y--y (х) which satisfies equation (1) within the 
interval la, 6] and the boundary conditions 


Ф, ly (а), y' (а)! = 0, 


Фа [y (b), y’ (b) = 0 
at its endpoints. 
Let us consider some kinds of a two-point boundary- 
value problem for equation (1). 
Assume, for instance, that we are given a second-order 
differential equation 


у" =f (т, у, y’) (3) 
with boundary conditions y (a) = A, y (b) = B (a < b), 
i.e. the values of the required function y = y (x) at the 
boundary points z =a and z — b are known. Then, 
“іп terms of geometry, the solution of equation (3) is an 


30—0104 


(2) 
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iilegral curve y = y (г) which passes through the given 
points М (a, A) апа N (b, В) (Fig. 9.4). 

Assume now thal, for equation (3), we are givon the 
values of the derivatives of the required function at the 
boundary points, i.e. у (a) = A,, у (b) = Ву. Then, 
iu terms of geometry, the solution of equation (3) means 
thal we have to find an integral curve y = y (т) of this 
equalion which would cut the straight lines z = a and 
т = b at the angles а = arctan A, and В = arctan 2, 


respeclively (Fig. 9.5). 
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Assume, finally, that, for equation (2), we know the 
value of the required function y (а) - A al one boundary 
point and the value of the derivative of this function 
y' (b) — B, at the other point. A boundary-value prob- 
lem of this kind is known as the third (mized) boundary- 
value problem. Ти terms of geometry, the solution of 
equation (3) means that we have to find ап integral 
curve y — y (т) of this equation which would pass through 
the point M (a, А) and cut the straight line z = b at 
an angle В = arctan 2, (Fig. 9.6). 

If the differential equation and the boundary condi- 
tions are linear, then the problem is linear. In that case 
the differential equation (1) and the boundary condi- 
lions (2) are writlen as 


y” i py Баб) у =f), (4) 
ү (а) BE ay’ (a) = MU (5) 
Boy (6) + By’ (b) = Үз» 


where р (г), q (г), / (г) are known functions continuous 
on the interval (а, б], «s, ол, Bos Bis ү, Ye аге given 
constants, and | а, | + |, 10, | Bo | + 1I BL | 40. 

If f (г) = О foras zx; b, then the equation is homo- 
geneous otherwise il is inhomogeneous. 

If vy, -= O and yg = 0, then the corresponding boundary 
condition is homogeneous. ТЕ both the differential equation 
and the boundary conditions are homogeneous, then the 
boundary-value problem is homogeneous. 


9.10. The Method of Finite Differences for Second-Urder 
Linear Differential Equations 


Assume that we are given a second-order linear differ- 
ential equation 


и" +p (т) у +9 (0) у =F (гс) (1) 
with Lwo-point linear boundary conditions 


ay (a) + ayy’ (a) == А, 9 
Boy (b) + Buy’ (0) = B (2) 


(1%] + la| == 0, [Bol + 1B.] #9) 


80* 
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and that p (r), q (г) and f (2) are continuous on the inter- 
val (а, b]. Furthermore, assume that ry = a, 2, = b, 
2, = 7, + ih (= 1, 2, ..., n —1) are systems о! 
equispaced nodes with a step h = (b —a)/n and р; = 
р (21), qi = 4 (т), fi = fn). 

We designate the approximate values of the function 
y (г) and its derivatives y' (т) and y" (т) obtained as a 
result of calculations at the nodes z; and y;, у; and y; 
respectively. In each interior node we approximately 
replace the derivatives y' (rj) and y" (гт) by the finite- 
difference relations 


, — ^ —2 i . 
yi de Yi yt — dea шн , (3) 
апа веб 
" У а” Yn- 
И = 1 = : Yn” h ” (4) 


for the endpoints 2, = a and rz, = b. 

Using formulas (3) and (4) we approximately replace 
equation (1) and the boundary conditions (2) by à system 
of equations 


i —2 + 
Ен ныи. 1р, xm Yi ay, fis 
(eot а, 27 7e =A, "ure 


We thus arrive at an algebraic system of n. + 1 equations 
in n + 1 unknowns. Solving such a system, we obtain а 
table of approximate values of the required function. 

If we replace у' (т) and у” (z;) by the central- 
difference relations 


” Vin — Yi- „ __ Visi —2yi T- Vii А 
у А, уре oe, (6) 





ме сап get more accurate formulas. However, we сап 
use formulas (5) for the derivatives at the endpoints. 
Then we get a system 


--2 " у 
Yin yi yi Lp p, инн азе} 


9400 + a, fs =A, (7) 
+ Un — Un-1 
Ву» + В, EE CEN =B. 





Ch. 9. Approximate Solving of Ordinary Differential Equations 469 


Example. Using the finite-difference method, find the solution 
of the boundary-value problem 
y" —zy' 4 -2y - z4-1, 
y (0.9) — 0.5y* (0.9) = 2, 
y (1.2) 21 
with an uccuracy of 0.001. 
А We divide the interval [0.9, 1.2] into parts with a step 
h = 0.1. Then we get four nodal points with abscissas rg =- 0.9, 
т, = 1.0, zg = 1.1, zy = 1.2. At the interior points гу = 1.0 and 
га = 1.4 we replace this equation by tho finite-difference equation 


Vis1— 2 - Jis1— Yi- . ) 
уі шін Log ныи і рула (01, 2). (э) 
Using the boundary conditions, we set ир finite-diffference 
equations at the endpoints: 


pers n ==2, (жж) 


уз — 1. 


Collecting terms and taking into account that п — 0.1, we rewrite 
equations (+) and (»«) in the forms 


Vii (2 -+ 0.144) — 4y,(1 — 0.01) + уз (2 — 0.1) = 0.02(z;-- 1), 
1.245 — yy = 0.4, уз = 1 


respectively. 
This problem reduces to the solution of the system of equations 


1.2yg — y1 0.4, 
2.149 — 3.969, 4- 1.9y, = 0.04, 
1.110, —3.96y, |-1.89у) 0.042. 


Solving this system, we obtain y, = 1.406, y, = 1.287, у, =1.149, 
уз = 1.000. А 


Exercises 


1. Using Picard’s method, find three successive approx imation 
of the solution of the following differential equations: 

(а) у’ >= Ay (1-х); the initial condition is y (0) = 1, 

y' — z — y; the initial condition is y (0) — 1. 

2. Find the first seven terms of the expansion in a power series 
of the solution y == у (z) of the equation y" + 0.4 (у)? + (1 + 
0.1z) y = 0 for the initial conditions y (0) = 1, y’ (0) = 2. 

3. Find a solution of the differential equation y' = z? + y? 
which would satisfy the initial condition zy = 0, y (z;) — 0. Hestrict 
the calculations to the terms of the expansion in a power series 
which involve 27. 

4. Setting k = 0.1, use Euler's method to solve tho following 
differential equations for thc given initial conditions on the indi- 
cated intervals: 
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(a) у = у + З=, y (0) = —1, z € [0, 0.5], 
(b) y’ = z — 2y, y (0) = 0, z € [0, 1]. 
5. Using improved Euler's method, find, on tho interval |0, 1], 
ә 
the table of solution of the differential equation у’ — y -- = for 


the initial condition y (0) = 1 assuming that h = 0.2. 

6. Using the improved Euler-Cauchy method, solve the 
differential equation from Exercise 5. 

7. Taking k = 0.1 find, by the Rungo-Kutta method, the solu- 
tions of the following differential equations for the given initial 
conditions on the indicated intervals: 

(a) y = z +p’, y (D = 0, z € [1, 2], 

(b) y = z? — y, y (0) = 2, г € [0, 1]. 

8. Use Adams' oxtrapolation method to solve tho difforential 
equation y' = 2z — y for tho initial condition y (0) =: 1 on the 
interval (0, 1]. The initial interval of the solution is given: yy =- 1, 
y, = 0.9145, y, = 0.8562, y, = 0.8225 (assume that k = 0.1). 


Chapter 10 


Approximate Methods 


of Solution of Partial 


Differential Equations 


10.1. Classification of the Second-Order Differential 
Equations 


Many important practical problems of hydrodynamics, 
heat and mass transfer, heat conduction, diffusion, the 
theory of elasticity and other fields of knowledge arc 
deseribed by linear partial differential equations of the 
second order, among which, equations in tivo independent 
variables* admit of the most simple and visual physical 
inlerpretation: 


Ay Wee 1-24 уу A- Cyattyy -| Өне | Batty 1 cu — F, 
(1) 


where u(r, y) is ап unknown function which must Бе 
defined, а, а», 655, б, by, с are specified functions of 
the independent variables z and y known as the coefficients 
of the equation, and F is the given function of z and y 
which is the right-hand side of the equation. Tf the coeffi- 
cients of equation (1) are constant, then it is a linear equa- 
lion with constant coefficients. Equation (1) is homogeneous 
il F.-0. 

A solution (integral) of equation (1) is any funcion 
which, being substituted for uin the equation, turns the 
equation into an identity. 

The necessary conditions for the existence and unique- 
ness of equation (1) essentially depend on tlie coefficients, 
0445 0,5, 034. We shall assume that at least one of the coef- 
cients is not identically zero (otherwise we would have 
a first-order equation). Tt turns out that the properties 


* Here and henceforth we use the following designations for 
д?и 


T ди д?и 
the derivatives: uy = rt "х= = gga "ху © фу and so on. 
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of the solution of equation (1) depend, to a large extent, 
on the value (the sign, to be more precise) of the dis- 
criminant A = а, -а44;; 

In connection with the difference in the properties of 
solutions and, consequently, the methods of solution, 
the following classification of equations is accepted. As. 
sume that the discriminant retains sign or is zero every- 
where in a domain D. 

Equation (1) is elliptic if А < 0, parabolic if A = 0 
and hyperbolic if А > 0. 

If the discriminant changes sign when passing from 
one point of the domain D to another, then the equation 
is of a mized type. 

This classification is due to the fact that elliptic, par- 
abolic and hyperbolic equations describe problems which 
are essentially different in their physical meaning and 
which deal with physical phenomena different in nature. 
Thus equations of heat conduction and diffusion (parabol- 
ic) express the laws of conservation of energy and matter. 
These equations are constructed on the basis of the laws 
of Fourier and Nernst which are similar from the point 
of view of mathematical formulation. 

On the other hand, the equation of oscillation of a 
string (hyperbolic) is the law of conservation of momentum 
and is based on Newton’s second law. 

Finally, an elliptic equation specifies a function which 
is quite different in nature and which defines stationary 
processes which do not vary in time. 

We know from the course in mathematical physics 
that under certain condilions imposed on the coefficients 
ауу, ду; and аҙ, (say, if they are twice continuously differ- 
entiable) there may occur a transformation of the vari- 
ables 

Е = % (т, y) 1 = (т, у), (2) 
which turns equalion (1) into опе of the following cano- 
nical forms? 

ша + Unn = / (an elliptic equation), (3) 
ша = f (a parabolic equation), (A) 

Ut = f OF ug — Unn = f (a hyperbolic equation). (5) 

Here / ="f (Ё, т}, и, ug, Uy) is a function of independent 
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variables, of an unknown function and its first. deriva- 
tives. Note that a hyperbolic equation has two equiva- 
lent canonical forms. 


For equation (4) with constant coefficients the Lranstormation of 
the variables (2) is linear and simplo in form. Consider these trans- 
formations for cach type of the equation. 

For elliptic equations 

z V 44144, — at ; 
E— -- 213, = - г, 6 
411 ! 811 (9 





For parabolic equations 


ат 
Byte, "- г. (7) 
For hyperbolic equations 
_ йа» . V ài, — аа,» 
E=y 4 г, = — an er (8) 


Note that for parabolic equations n may, in general, be ап 
arbitrary function independent of E. 
| Example. "^duce the equation uyy F их, — F to canonical 
orm, 

A Неге а 1, ау, - 0.5, аҙ, - О and, therefore, the discri- 
minant A = 0.5? — 1. 0 - = 0,95 > 0. Consequently, this is a hyper- 
bolic equation. "быш the appropriate transformation of variables 
(8), we obtain 


1 . 1 
Uxx -F (use + 2ugq + итп), Шуу — y (ugg + ит). 
Thus the canonical form of the original equation is 


Us — ünn = —4F (Е, 0), 
where 

FE, m-—F(-2,t—m. 
We lave obtained the second canonical form. 


We can show that the transformation of the variables а = Е + 
n, В = Ё — n leads to the first canonical form чан = —F (В — 


а, 6). А 
In what follows, we consider the canonical forms (3)- 
(5) of equation (1). 


10.2. Classification of Boundary- Value Problems 


In this section we discuss the simplest canonical equa- 
tions (3)-(5) from 10.1. We have mentioned (in Sec. 10.1) 
that different types of equations describe different phys- 
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ical processes. Thus, the equalion* 


иң — Uxx = f (4, t), (1) 


is Lhe equation of oscillation of a string and deseribes the 
processes connected with the mechanical, clectrical, 
acoustic and other kinds of oscillation. 

The equation 


Uy = Uxx = f (г, t), (2) 


known as the equation of heat conduction, describes heat 
flow, diffusion and other processes of transfer. 
The equation 


Uys + lyy = Í (г, y) (3) 


known as Poisson’s equation describes a stationary ther- 
mal field, a potential flow of fluid and other. physical 
phenomena connected with transition lo a steady state. 

To describe a physical process completely (uniquely), 
we must. indicate the equation of this process and, in ad- 
dition, specify the initial conditions (the initial state 
of the process) and the conditions for variation of a cer- 
tain function on tlie boundary of the domain in which the 
process takes place. In terms of mathematics, this 18 
connected with the nonuniqueness of the solution of the 
differential equation. Therefore, to define the solution 
uniquely, we must define the equation itself and, in addi- 
tion, to impose additional conditions which are classi- 
fied as initia and boundary conditions, Three types of 
boundary-value problems are distinguished. 

Initial conditions are conditions which define, at a 
certain moment, known as the initial moment, the value 
of the required solution (and sometimes ils time deriva- 
tives too) for all points of the domains being considered. 

Cauchy's problem is the first type of boundary-value 
problems (initial-value problem). This is the problem of 
solving equation (1) or (2) for which only initial condi- 
tions (the initial stale of the process) are delined as addi- 
tional conditions. 


* Herovanod henceforth, for better physical visualness, the 
variables z-and y correspond to the space coordinates and 2 to the 
time coordinate, 
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Cauchy's problem does not involve boundary condi- 
lions. This problem is formulated for hyperbolic and 
parabolic equations. The absence of boundary conditions 
is due to the fact that we consider either an unbounded 
domain or a small initial time interval when the elfect 
of the boundary is negligibly small. 

A problem without initial conditions, which involves 
only boundary conditions, is the second type of a boun- 
dary-value problem. In their turn, boundary conditions 
are usually divided into three kinds. 

А boundary condilion of the first kind is a condition un- 
der which the required function assumes specified values 
on the boundary of the domain being considered. 

A boundary condition of the second kind is a condition 
under which the normal derivative of Ше required func- 
tion must assume specified values on the boundary of 
the domain being considered. 

A boundary condition of the third kind is а condition 
under which ^ linear combination of the required func- 
tion and its normal derivative is specified on the 
boundary of the domain being considered. 

From the point of view of mathematics, boundary con- 
ditions of the first and second kinds are special cases 
of conditions of the third kind. However, they have been 
separated not only for historical reasons but also due to 
their essentially different physical interpretation and a 
definite difference in the methods of solving the corre- 
sponding boundary-value problems. 

The initial conditions in applied problems шау be 
absent when these problems involve moments of time 
sufficiently distant from the initial time moment, when 
the effect of the initial conditions is weak. Problems of 
this kind are often called steady-state problems. Problems 
of this type can be formulated for all kinds of equations 
(1)-(3). 

The third kind of a boundary-value problemi is a 
mixed problem in which both initial and boundary condi- 
Lions are specilied. This is a generalization, in a certain 
sense, of problems of the first two kinds. Cauchy's prob- 
lem and a boundary-value problem without initial con- 
ditions are two extreme limiting cases of the mixed prob- 
lem. The former is the limiting case for e sufficiently small 
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time interval and the latter, for a sufficiently large time 
interval. The mixed problem is formulated for hyper- 
bolic and parabolic equations. 


10.3. Statement of the Simplest Boundary- Value Problems 


In this section we consider various statements of bound- 
ary-value problems on the assumption that their solu- 
tions are sufficiently smooth. Here and in what follows 
we understand the sufficient smoothness of a function to 
be tie continuity of the function and of the necessary 
number of its derivatives. In the statement of boundary- 
value problems, the sufficient smoothness usually means 
the continuity of all functions and derivatives appearing 
in the differential equation and the boundary conditions. 

The classical solution of a boundary-value problem 
is any function which satisfies the differential equation at 
every interior point of the domain of delinition of this 
equation and is continuous in the domain being con- 
sidered, including the boundary. 

The corresponding statement of а boundary-value 
problem is called classical. Thus a classical statement 
automatically imposes some restrictions on the input 
data of the boundary-value problem. Thus, for instance, 
it is required that the right-hand side of equations (1)- 
(3) be continuous and the boundary functions be suffi- 
ciently smooth. Note that in the most interesting applied 
problems the right-hand sides have essential peculiari- 
ties and therefore it is not sufficient to make a classical 
statement. In such cases we introduce the concept of a 
generalized solution, which we shall not discuss here but 
shall only consider the classical solution. 

Let us pass now to the statement of problems. 

Cauchy's problem for an unbounded domain. We shall 
formulate this problem for the equation of oscillation of 
a string and the equation of heat conduction. 

We shall consider the process of oscillation of a thin 
infinite (very long) string under the action of a continuous- 
ly distributed external force with density f. We assume 
that the force acts in one plane (Fig. 10.1), the plane of 
oscillation of the string (r, u) and thestring is a flexible 
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elastic thread. Let the value of the tension which appears 
in the string due to its bending obey Нооке'ѕ law and 
the oscillations themselves be sufficiently small. Then 
the value of the displacement и (2, t) satisfies the equa- 
tion of oscillation of the string 


Uy — Ихх = f (t) (t T9, —oo < T < oo). (1) 


For the process to be unique, we must also specify the 
initial displacement and the initial velocity distribu- 





Fig. 10.1 


Lion. In erms of mathematics, this corresponds to the 
specification of the initial conditions: 


и (г, 0) = ио (2), ш (ғ, 0) = u, (4). (2) 


We have to find the classical solution of equation (1) 
which satisfies the initial conditions (2). 

Thus formulated, problem (1), (2) is known as Cau- 
chy's problem for a hyperbolic equation. 

Let us investigate now the process of temperature 
distribution in a thin infinile (very long) bar. We as- 
sume that the heat. flow obeys Fourier's law and the varia- 
tion of the body temperature is proportional to the quan- 
tity of heat imparted to the body. We assume that inside 
the bar the heat, characterized by the density of heat 
sources / can be liberated and absorbed. Then the distri- 
bution of temperature in the bar is described by the 
equation of heat conduction 


ш — Use = Í (г, t) (t >0,-- < T < ос). (3) 
For a unique definition of the process, it is necessary 


to indicate the initial distribulion of temperature. This 
corresponds to the specification of the initial condition 


и (г, 0) = шо (2). (4) 
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We have to find the classical solution of equation 
(3) which would satisfy the initial condition (4). 

The problem (3), (4) we have formulated ‘is known as 
Cauchy's problem for parabolic equations. 

When posing boundary-value problems and especially 
when finding numerical solutions, it is necessary to an- 
swer the following three fundamental questions corre- 
sponding to the natural physical requirements: 

(1) whether a solution of the problem exists and whether 
or not the boundary conditions redefine it, 

(2* if a solution exists, then whether it is unique, 

(3) whether the solution continuously depends on the 
initial data of the boundary-value problem (f, uy, щш, 
elc.), i.e. whether it varies continuously with a contin- 
uous variation of the right-hand side of the equation 
and the boundary conditions. This property is called the 
stability of the solution relative to the input data. 

A boundary-value problem is correct if ils solution 
existis, is unique and stable. 

The classical Cauchy problem for the equation of oscil- 
lation of a string is correct if the functions f, ua and u, 
are sufficiently smooth. 

For Cauchy's problem for the equation of heat conduc- 
tion to be correct, in addition to the smoothness of / 
and ио, it is also necessary that the solution be limited. 

А stationary problem (a problem without initial data). 
Let us consider a steady-state condition of temperature 
distribution -in a bounded thin plate of an arbitrary 
shape with a smooth boundary. Let the function u (г, y) 
express the temperature at every point of the plate. Un- 
der the ordinary laws of heat distribution described above 
when Cauchy's problem for the equation of heat conduc- 
tion was formulated, the function u (2, y) satisfies 
Poisson's equation 


Uxx + Uyy = f (т, у), (т, y) € D, (5) 


where the function f defines the density of heat sources 
of the plate. Wlien there are no sources (/ — 0), equation 
(5) becomes Laplace's equation: 


Use + Uyy = 0. (6) 
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For the description of the process to be unique, we 
must define the heat conditions on the houndary of the 
plate. We can do this hy specifying or distributing the 
temperature on the boundary, or, else, by distributing 
the heat flow. 

The conditions of heat balanee of the radiating body 
and the medium are also possible. Depending on heat 
conditions on the boundary, we distinguish three bound- 
ary conditions for the function u (ғ, y). Let C be the 
boundary of the domain J) of definition of equation (6). 
In terms of mathematics, the boundary conditions can 
he formulaled as follows: 

the boundary condition of the first kind: 


Ule = Фо (0 yh (ру ЄГ, (7) 


the boundary condition of the second kind: 


d 1 
= |. -= (Pi (x, y) (2, y) € І , (8) 
the honos y condition of the third kind: 
2 1 
ГД yb aul = Ф. (2, y) (т, yer. (9) 





The derivative is taken with respect to the outer nor- 
mal to the curve Г, А >> 0 is the thermal conductivity, 
Pos (Pı and «р„ are functions defined. on Г, ду, being the 
product of the thermal conductivity by the temperature 
of Lhe medium which is in contact with the body. 

Thus the boundary-value problem consists іп finding 
the classical solution of equation (5) or (б) satisfying one 
of the boundary conditions (7)-(9). 

Depending on the kind of the boundary conditions, 
three. boundary-value problems are. distinguished: the 
first boundary-value problem (5), (7), which із Diri- 
chlet's problem, ihe second boundary-value problem (5), 
(8) which is Neumanu's problem and the third boundary- 
value problem (5), (9). 

For sufficiently smooth input data, the first and tho 
third problem for the equations of Poisson and Laplace 
are correct. 

For Neumann's problem, the uniqueness theorem con- 
sists in the fact that under the same boundary conditions 
two of ils solutions may vary by a constant quantity. 
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In problems of mathematical physics, of considerable 
importance are harmonic functions. 

A function u (z, y) is harmonic in a domain D if it is 
continuous together with its second-order derivatives 
and satisfies equation (6) in this domain. 

Here are some properties of harmonic functions. 

1° (principle of the maximum). 7f the function и (т, y) 
is defined and continuous іп D =D |T and satisfies equa- 
tion (6) in D, then и attains its mazimum and minimum 
values on the boundary T, i 


max u(z, у) < max u(r, у), 
(x, WED (x, ver 
min u(z, y) > min uu (г, у). 
(x, зер (x, wer 
2° (a consequence of property t°). If the functions и (т, y) and 


ә (т, y) are continuous in 2 harmonic in D and u S v for (т, y) ET, 
then ux; v јог (т, y) € 
3 (a consequence of property 1°). If the functions и and v are con- 


tinuous in D, harmonic in D and |u |S vfor(z, y) E€ l then ul 
v for (2, y) €D 

The mixed boundary-value problem. Let us consider 
a problem of heat propagation in a thin bar of unil 
length. We place one of its ends at the point z = О and 
the other end at the point z — 1. In the time interval 
0<1 < T the temperature distribution in such а bar 
is described by the equation 


ш-иа-/(0<:<1.0<14<7) (10) 


with the initial condition 
и (z, 0) = ие (z) (0x rx. 1), (11) 


and for the solution to be unique in this case, it is also 
necessary to specify the temperature conditions at the 
ends of the bar. We can do this with the aid of boundary 
conditions similar to those formulated for the equations 
of Poisson and Laplace. 

The boundary condition of the first kind (the tempera- 
ture is spgcified at the end of the bar z = 0) is 


и (0, t) = Фо (t) (0<1< 7). (2) 
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The boundary condition of the second kind (the heat 
flow is specified at the end of the bar z — 0) is 


ux (0,1) = Ф (|) O<t<7). (13) 
The boundary condition of the third kind is 
—us (0, t) + àu 0,2) = (0 0<:<7. (9 


For the other end of the bar z = 1, the right-hand sides 
of the boundary conditions (12)-(14) are replaced by 
Фо (D, p(t) and wv, (f) respectively. Note that the initial 
and the boundary condition must satisfy the so-called 
matching conditions, i.e. ug (0) = % (0) under condition 
(12), иә. (0) = Ф; (0) under condition (13) and —u,, (0) + 
Au, (0) = Ф, (0) under condition (14). Similar mat- 
ching conditions must be fulfilled al the other end of the 
bar x = 1. 

Thus, fer the first boundary-value problem the mat- 
ching conditions mean that 


ио (0) == Po (0), us (1) = % (О). (15) 


In the general case, different conditions may be аі 
different ends of the bar so that the total number of all 
possible combinations of boundary conditions is б. 

Here is one of the possible boundary-value problems. 
We have to find a solution of equation (10) which would 
satisfy the initial condition (11) and the following boun- 
dary conditions: 


и (0, 2) = % (0), и (1, t) = ч» (0) 0 — tx 7). (16) 


Problem (10), (11), (16) is known as the first boundary- 
value problem for the equation of heat conduction. Cor- 
respondingly, the boundary-value problem (10), (11) 
with the boundary conditions (13) or (14) at both ends 
of the bar is the second or the third problem. 

Other boundary-value problems with various combi- 
nations of boundary conditions (12)-(14) at both ends 
of the bar are posed by analogy. 

Boundary-value problems of the first, the second and 
the third kind are correct if the corresponding conditions 
of smoothness and maiching are fulfilled for the input 
data. 


31—0104 
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The solutions of the equation of heat conduction possess 
the following significant property, which is similar to 
the property presented for the solution of Laplace's equa- 
tion. 

The principle of the maximum. Tf the function u (т, t) 
is continuous in the domain Dr (0 << tx; T, Ox; т< 1) 
and satisfies equation (10), then for f = 0, the mazimum 
and minimum values of the function u (z, t) are attained 
either at the initial moment or at the point т = 0 or z = 1 
of the boundary. 

Let us consider now the oscillatión of a thin string of 
unit length. The value of the displacement u (г, 2) 
is described by the hyperbolic equation | 


Ut — uxx =f O<zr<i, t —0). (17) 
Іп this case the initial conditions have the form , 
u (г, 0) = ш (2), ш (т, 0) = шіт) (0 < z < 1). (18) 


We shall consider the boundary conditions in the same 
form as for the equation of heat conduction, i.e. (12)- 
(14). Problem (17)-(18) with the same boundary conditions 
at both ends of form (12)-(14) is the first, the second and 
the third boundary-value problem, respectively, for a 
hyperbolic equation. All these problems are correct if 
the corresponding conditions of smoothness and matching 
are fulfilled for the input data. 

As an exaniple we shall formulate, the first boundary- 
value problem for the equation of oscillation of a string. 

We have to find a function и (z, t) which would satisfy 
equation (17), the initial conditions (18) and the fol- 
lowing boundary conditions: 


и (0, t) = Po (0), и (1, 0) = Po (t) (t 20). (19) 


The physical meaning of the boundary conditions of 
the first kind is that both ends of the string oscillate in 
present modes according to the laws of the given functions 
Po andíw,. The boundary condition of the second kind 
corresponds to the fact that a law of the action of a forco 
is defined &£ the endpoint. The boundary condition of the 
third kind corresponds to the elastic fastening of the end 


of the string. 


Ch. 10. Solving Partial Differential Equations "483 


10.4. The Method of Finite Differences. The Principal 
Concepts 


For the simplest boundary-value problems formulated 
in 10.3, certain exact solutions are given in various courses 
in mathematical physics. But the majority of even 
linear equations which describe practical processes are 
such that they do not admit of constructing an exact 
solution by means of elementary functions. In such cases 
we resort to approximate methods. We usually consider 
two kinds of approximate solutions, analytical and numer- 
ical. We shall consider numerical methods based on the 
difference approximation of the derivatives. This ap- 
proach is. known as the difference method, or the method 
of finite differences. 

To cut down the computations, we shall illustrate this 
method usiag the simplest equations (for which, maybe, 
an exact so!ntion has been obtained), bearing in mind 
that the main principles of constructing difference 
schemes can be extended to more general equations. 

Consider a linear differential equation written in the 
following symbolic form: 


Lu (т, y) =f (т, y) (т, у) € D. (1) 


Неге u is the required solution of the equation, L is а 
differential operator symbolizing the corresponding oper- 
ation of differentiation, and f is the right-hand side of 
the equation (the given. function). 

As is known, for the solution of equation (1) te be 
unique, it must be supplemented with the boundary 
and initial conditions. We write these conditions in the 
form of a symbolic relation 


lu (z, y) = € (теу), (в ET, (9) 


where / is an operator symbolizing the left-hand side 
of tho boundary condition, ф is the right-hand side of the 
boundary condition (the given function) and T' is the 
boundary of the domain D. ` ` ' i 

We shall illustrate the principal concepts of the method 
of finite differences by the solution of the Dirichlet 
problem for the Laplace equation in the square D° 
0<т<1,0<у<1) with the boundary IY {z = 
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0,2--1,0<у<4; y=0,y = 1, Ох тс 1}: 
Lu = ихх + Uyy = 0, (z, y) € D*, (8) 


и (т, у) = ду (к +1) (у 10), mper A 


Thus, for problem (3), (4), the operator L transforms 
the function и into a differential expression uz; + Uyy. 
In such cases we write that 

62 0a 
La 
the right-hand side of the equation f — 0, the operator 
of the boundary conditions is an identity operator, i.e. 
it transforms the function и into u: lu = u, the right- 
hand side of the boundary condition has the form 


0, z—0,0z yx 1, 

. 0, 0 x x1, у== 0, 
q(r, у) == A у(у--4), т-4,0<у<1, 
5.20261), 09291, уз1. 


Тһе difference method of solving problem (1), (2) сап 
be presented as two stages: 

(1) constructing the difference scheme which approxi- 
mates the given continuous problem, 

(2) solving the difference problem and estimating the 
error of the solution. 

We shall dwell on these problems in more detail. 

When constructing the difference scheme, the first 
step is to replace the domain D of the continuous varia- 
tion of the arguments by the domain of their discrete 
variation, i.e. by the net domain (or simply net) wp, 
i.e. by the set of points (x,, Ym) called the nodal points, 
or nodes, oí the net. For the square D? the net domain can 
be constructed as follows. We draw straight lines 


ть = nh, yg = mh (h = A/N, n, m = 0,4, .. ., М). 
(5) 


Ch. 10. Solving Partial Differential Equations 485 
The set of intersection points (z,, Ул) of these straight 
lines constitutes the net domain од and the points them- 
selves form the nodes of the net. Every function v (z, y), 
defined on the net оһ, is a net function and is often desig- 
nated as vy 
The second step in constructing the difference scheme 
is the approximation (approximate replacement) o( the 
differential expression Lu by a difference expression and 
the function f of the continuous argument by a net func- 
tion, i.e in constructing a difference analogue for equa- 
tion (1). The same refers to the boundary conditions (2). 
Such an approximation leads to a system of algebraic 
equations with respect to the values of the net function 
Va. We can write this syslem of equations as 


ЕЛУ = һы (6) 
Livan = Phs (7) 


where La and фу, are difference operators* which approx- 
imate L aud 4 respectively, v; is Ше required net func- 
tion which approximates the solution и, /, and фу are 
the given net functions which approximate f and ф 
respectivoly. 

The collection of tho difference equations (6), (7) 
which approximate the original problem (1), (2) is known 
as the difference scheme. Note that, in general, the origi- 
nal problem can be approximated by different difference 
schemes and one and the same difference scheme can ap- 
proximate different continuous problems. 

By way of example, we construct a difference schemo 
for problem (3), (4). 

For the solution u (r, y) we construct a net function 
и, defined as follows: иһ (£n, Ym) = U (Lay Ут). In what 
follows, in order to simplify the notation (where no 
ambiguity arises), we shall omit the index k in the net 
functions and especially in their values. Thus Unm = 
иһ (In, Ут). Using this notation, we approximate 
every derivative from equation (3) by a difference rela- 


* Note that we understand the concept of the operator here 
as the abhreviation of the symbolic notation for differentia] and 
difference expressions, 
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tion: 
Use (2а, Ym) =- (Шъ ат — Unm + Unit): 
Uyy (Zn. Ym) S zr (n m-i— Dum + Unmet)» (8) 


Then we can approximate the differential equation (3) 
by the difference equations 


+ (Van-1,m + Un,m-1 + Vatim + Un, mi — 40m) =0 (9) 
(n, т--1,2,..., N—1). 


Hence we have 


1 
Unm = PN (Unam + Yn tim Un ,m-1 + Ёп,т++) (10) 
(n, m — 1, 2, .... N — 1). 


The boundary condition (4) can be approximated as 
follows: 


Vom = 0, Uno = 0, 


24 m(m+N) 1 n(n4-N) 
Ym =p Na? Pan yp з 
(n, m=0, 1, ..., М). (14) 


The system af equations (10), (11) is usually solved 
by the method of simple iteration or by Seidel's method. 

Comparing relations (6), (7) and (9), (11), it is easy 
to understand. the meaning of the difference operators 
and net functions of system (6), (7) and their relations 
with the corresponding operators and functions of prob- 
lem (1), (2). 

The difference expression Lav, is a linear combination 
of the values of the net function at some nodes. In partic- 
ular, the difference expression (9) contains five nodes 
(a Дүе-поде scheme) known as a "cross" scheme (Fig. 
10.2) 

Thus for m — 1) unknown values vam (n, m= 
1,2, ..., N —1) of the nel function rv, ме get a 
system of (М — 1)? equations (9) or (10) in which the 
quantities Vom, Uno, Uum, Un м are defined by the boundary 
conditions*(11). We can regard relations (9), (11) as a 
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consistent system of (М + 1)? —4 equations іп 
(М + 1)? —4 unknowns vz, (n, т--0,1,..., №), 
except for Voos Юм», UNN: Омо: 

Intuition prompts us that the more accurate the approx- 
imation of type (8), the closer the function v, to u,. 
Therefore, at this stage we introduce a strict concept of 
approximation. 

The solution v, of problem (6), (7) is a net function and, 
consequently, it depends on the parameter й, i.c. on the 


t, m1 





Fig. 10.2 


step of the net. À natural question arises concerning the 
possibility, iu principle, to approximate the solution 
и (т, y) of problem (1), (2) by the solution v, in a finite 
number of actions by choosing an appropriate stepsize 


We shall compare two net functions v, and иһ = 


u (т, y) (rz, y) E€ ©» To find how close the two net 
functions are, we define the concept of the norm on the 
вер of net functions as follows: 


lul] = max [v(z, у)|. (12) 
(x, veo, 
In definition (12) we take the maximum over the doniain 


of definition of the function which is under the sign of 
the norm. 


Let us consider the error of the difference scheme (6), 
(7): 2, = v, — иһ. Substituting v, = 2, -+ и, into (6), 
(7), we get, for 2,, a problem similar to that for v,: 

Г == ў, — Lan, (13) 
Іар = Ф — иһ. (14) 

The right-hand sides of equations (13), (14) constitute 

the error of approximation of equation (1) by the difference 
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equation (6) and the error of approzimation of the bounda- 
ry condition (2) by the difference condition (7) on the so- 
lution of the original problem (1), (2). 

We say that the difference scheme (6), (7) approzimates 
problem (1), (2) with the order k > 0 relative to h on the 
solution и (zx, y) if 


ПА = Съ < ch, np, — іш < czk", (15) 


where c, and c, are constants independent of h. 

We shall determine the order of approximation for the 
scheme (9), (11), or, which is the same, (10), (11). Sinco 
the boundary conditions are exactly defined on the net, 
the left-hand side of the second inequality (15) is zero 
and the order of approximation is defined by the first 
inequality (15). 

The right-hand side of equation (3) is zero and therc- 
fore we only estimate the norm of Lau. 

We use Taylor's formula: 


h3 f du 
Un31, m=Unm (55) +> (Эй) 








"nm 
h3 ү Bu hå [дш \+ 
E (5), 1 24 (ғ), 
дќи \ + 
(а "2 “81% u (En + 6), уһ), 0«0,— 1, 


h? ү ди 
Us msi = Unm + h (= ду ), „К? (ғ ).. 
h3 Bu Һ 104% ұз 
xu (ғ), КЕЛЕЛІ 


94 \ = 9% 
(o е yt U(Zn, Ym + №), 0 «0, — 1. 





Summing up these four relations, we obtain 
Un +4, m+ Un- 1, m+ Un mes Tin т-і 


= = 4и, + h*| [(Usz)nm + (uyy) nm] tour al ( i ) 


дї \- д ү+ дќи 
+ EM ду" ) + ( ду! т. 
Using the difference relations M we find that 


| Laus] < AM, (16) 
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дц tu 

here M,= max. тё |, dy 
(x, WED 

the existence of the corresponding derivatives. Thus 

scheme (9), (11) has the second order of approximation. 

This completes the discussion of the first stage, i.e. 
the construction of a difference scheme, and now we pass 
to the second stage, the solution of the difference problem 
and evaluation of the error. 

The most significant problems that arise at this stage 
are those of the solvability of the difference problem, the 
uniqueness of its solution and the continuous dependence 
of the solution on the input data. The input data are 
the right-hand sides of the difference equations and the 
boundary and initial conditions of the difference problem. 
We can formulate the concept of the correctness of a 
difference scheme in the same way as we pose tlie question 
concerning the correctness of problems of mathematical 
physics. Let v, be a solution and f, and q, the input data 
of a difference problem (б), (7). The solution and the in- 
put data evidently depend on Л, 

We say that a difference problem. (scheme) is correct 
if the following conditions are fulfilled for all A < h, 
(ho — 0): 

(1°) a solution of the difference problem exists and із 
unique, 

(2°) the solution of the difference problem continuously 
depends on the input dala. 

We can write condition 2? for the difference problem 
(6), (7) as follows: 


On — va ls My Hl fo. -АҺП-- Ma ln — s |Ь (17) 


where the symbols without a bar correspond to one prob- 
lem and those with a bar to the other. 

This condition is known as the stability of a difference 
problem (scheme) with respect to the input data, or simply 
Ше stability. 

It is proved in the theory of difference schemes that 
the "cross" scheme, constructed for Dirichlet's problem, 
is correct for Laplace's equation (and, in general, for 
Poisson's equation). 

Having formulated the concepts of approximation and 
Stability for difference schemes, we arrive at the most 


). We assume here 
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significant problem, that of the convergence of the solu- 
tion of the difference problem (6), (7) to the solution of 
the continuous problem (1), (2). 

We say that the difference scheme (6), (7) converges at the 
rate of s >O relative to h if the condition 


|| và. — ua l| < ch 


is satisfied, where c is a constant independent of h. 

There is a close relationship between the concepts of 
approximation, correctness and stability which is de- 
fined hy the following theorem. 

Theorem. Let the difference problem (6), (7) approximate 
problem (1), (2) on the solution и (z, y) with the order of 
k > 0 relative to h and be correct. Then this scheme con- 
verges with the order equal to the order of approximation k, 
i.e. the estimate 


|| vn — un (S ch^ (18) 


is satisfied. 
П By the definition of approximation we have 


Wha — іші << ch", ||ф„—1кик|| < са h*. 
Using relations (13) and (14), we obtain 
И лаһ IIS eh, |І 1,2 I< сл". 


Then, by virtue of the assumption of the stability for the 
difference schéme [relation (17)], we have 


ll za E< My Il Erza Il -H М» I laza ||, 
whence, using the estimate just obtained, we find that 
ll zn I| — Wun — un IS Mich* +- Mach = chk. m 
Example 1. Find the solution of probloms (3), (4): 
Uzx-+ шуу =0, (z, y) CD*, 
u (z, 9) o zy (24-1) (04-9), (z, ET. 


Here D? is a square (0 < 2 « 1, 0< y < 1) with the boundary ГО 
{= = 0, т = 1, 0<у<1, у = 0, у= 1, 0< rx 1}. 
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. A The system of tho finite-difference equations has been written 
for this problem in the general case and has the form 


олт =ч (vn-1, т-Е®п+1, топ, т-і- Әп, те) 
(п; т--1, 2, ...% N—1), 


(Vom = Ung = 9} 


1 т(т--М) 1 n(n-|-N) 


0 977 а. AN үз 
(п; т--0, 1, ..., М). 


Assuming h = 1/3 (М == 3) as tho stepsize of the net, wo construct 
a table of boundary conditions and unknown values: 


Table 10.1 
0 | "E | Van | 0,556 
0 | | 0.222 





The initial system of equations for the unknown values assumes 
the form 


v= i (0--еҙ1--0-- әз) 
ins 7 (1-а оа 0222), 
var =e (Yar 2204), 
=. (0144-0.556 + оа -[-0.556). 
Let us now use the method of simple iteration to solve this 
system. To do this, we havo to get the initial values of the un- 


knowns. We shall obtain them by means of a linear interpolation 


using the boundary conditions, first for the rows and then for the 
columns. 


We shall carry out the linear interpolation for the rows using. 
the formula 


— m 
Опт = Vom + (UNm — Vom) "yr - 
This yields (n, m — 1, 2) 
лла = 0.185, а = 0.371, vy = 0.074, 9 = 0,148, 
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We shall carry out the linear interpolation for the columns using 
the formula _ 
Опт = Vno t (VaN — Vno) + " 
This yields (n, m, — 1, 2) 
va = 0.148, v4, = 0.074, Dzs = 0.371, Dz, = 0.185. 


Wo take the half-sum of tho values obtained 


опт = i (опт +Unm), 
i.e. 00, = 09, = 0.166, 09, = 0.371, v9, = 0.074, as the initial 
values. 
We can now perform the iteration process: 


4 1 
vit! => vto, vid! = (04-08, 4- 0.222), 


1 , 
vid! => (via - 0.556). 


We have used thesymmetry of tho initial data (07, == v],) and 
of the system of equations. We shall continue with the solution of 
this system until two successive iterations coincide with an accura- 


cy of 0,001. The results of calculations are in Table 10.2. 


Table 10.2 
Number of iteration 
0 1 2 
Uii 0.074 0.083 0.084 
ПЕСО 0.166 0.167 0.106 
Vaz 0.371 0.361 0.362 


Two iterations proved to be sufficient to got a solution. This 
speaks of the simplicity of the difference problem due to the large 
stepsize of the net. A 

Example 2. Find a solution of Laplace's equation (3) in a unit 
square under the following boundary conditions: 


0, 0<:<1, у--), 


- y (64у* — боу +29), z—0, 0 <y « t, 
u (z, y= 
~z (1—7) (6429682433), 0<2<1, у=1, 
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A We set h = 0.25 and construct system (10) taking the boun- 
dary conditions into account: 


1 
йт = y 24 934 40 of 2), 


EN 
hii Lon jh k 
v = y (Ph tos 04-933), 
hi | tyr k 1 
vt = т (924:-0--0--%;)--- vis 
м. 1 kh k È 
vig = Ap (20-4 v4 Ev Hota) 
Apis tein k k hy 1 үт А 
vsa = су (vie toia Hoza Hog) = xr (Prete) 
м1 ah Lh 1 
ia = g (40-039 toig +40) = 20-4 97 012, 
Тіс bourdary conditions and the unknown values are given іп 
Table 10.3. 

Table 10.3 
| 40 | 20 | 12 | 
ee S S S 
40 | Vis | Vas | Ugg | 0 
20 | Vie | Vag | Оза | 0 
12 Uii | Usi | Оз | 0 
0 | 0 | 0 


We have used the symmetry property, Vam = Uy-m.n-n: to 
construct this system. 

We shall calculate the initial approximation with the aid of the 
linear interpolation using the boundary conditions at the interior 
nodes. Using the formula 


12 (1—5) 


to caleulate v2,, we get >, = 9, v9, = б, v), = 3. By virtue of 
symmetry, we set v5, = 00, = 6, v, = 00, = 9 
Using the formula 


7 
vo, = 20 (13 п) 
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to calculate 92, and о2,, wo get v), = 15.33, vj, = 10.66. By virtue 
of symetry wo set v2, = vj, = 15.33. 
The last value, vis, we get from the formula 


40 —15.33 
2 


v? = +40— :1—27.87. 


We shall use two methods to solve this system: the method of 
simple iteration (Table 10.4) and Seidel's method (Table 10.5). We 
shall continue the calculations until two successive solutions for 
each variable coincide with an accuracy of 0.1. The method of sim- 
ple iteration required four iterations and Seidel's method required 
three. 

The final solutions are given in Tables 10.4 and 10.5. A 


Table 10.4 





Table 10.5 





10.5. Difference Schemes for Solving the Equation o 
' Heat Conduction 


Let us tonsider the first boundary-value problem for 
the equation of heat conduction in a rectangle D {0< 
1<1,0<#<,7}. We have to find a solution of the 
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problem 
Lueu—us,—f(0«z«10-tszT), (4) 
и (т, 0) = ио (2) (0s zx 1), 2) 
и (0,4) = po (t), u (1,4) -% ( (Ox t< T) (3) 


continuous in D. 

Ав we did in 10.4 for Poisson's equation, we use the 
difference method to construct the solution of problem 
(1)-). | 

In the dolnain D, we introduce a uniform rectangular 
net олт (rp, ta} with the stepsize k = 1/N with respect 
to the coordinate т and with the stepsize т = 7/М with 
respect to the coordinate t: 


Т, = nh (n = 0, 1, ..., N), tn = kt (k =0,1,... M). 


We approximate the derivatives of the left-hand side 
of equation (1) by the following difference expressions: 


hi, yà yh uh! 
(шул = ----- ‚ ог (ш) S ---- , 
һ , 
ha, Un-i Et 
(Uxz)n = E кз . (4) 


In accordance with approximation (4) we construct two 
difference analogues of equation (1) with the unknown net 
function рдү; 


Dod . pàti А k h k 
L Conon 0р %-1-20- Una _ gk 5 
һ0һ rs = fas (5) 
k_ k-i ko E Y ' 
І 22 Әлің Un 1 — 200 1-0 op 6 
"Uh = 1 mni . күт] = fs. ( ) 


Here f^ ‘are tlie values of a net function fy corresponding 
to the right-hand side of equation (1), say, f^ = f (Zn, Ё). 


We usually assume ft = f (zn, th +5) for scheme (5) 


and fà = f (zn, tr –5) for scheme (6). 
We can exactly «ейпе the initial and the boundary con- 


dition for the first boundary-value problem: . 
ж = ug (nh) (n = 0,1, ..., М), 
vè = Po (Ет), v = wv, (Ет), (Е = 0,1,..., М). (7) 
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In the case of the second and third boundary-value prob- 
lems, the boundary conditions are approximated with the 
use of formulas similar to relation (4). 
Four-point schemes (5) and (6) are shown in Fig. 10.3. 
Scheme (5) is ezplicit and scheme (6) is implicit. 
This definition is due to the fact that scheme (5) in the 
explicit form defines the successive, in time, values of 


[ ki n-1,k nk п+, К 


п-1, k nk ntl, К 
n, к-1 


Fig. 10.3 


the unknown net function relalive to the preceding val- 
ues. Indeed, setting r = т/А?, it is easy to find from re- 
lation (5) that 


vat! =r (vh-1-- Un41) + (1 —2r) ont tfh. (8) 
Thus, using conditions (7) and the explicit formula (8), 
we can find, in succession, any value v*. Consequently, a 


solution of system (7), (8) exists and is unique. 
It is different with scheme (6). We rewrite it as follows: 


туй ,.— (1+ 2r) vh + TVA д --- (E! +Ë). (9) 
This scheme yields the values of the required net function 
in an implicit form, i.e. as a system of equations. We 
can show that a solution of system (7), (9) exists and is 
unique. It is usually found by the method of factoriza- 
tion which we shall not consider here. 

The order of approximation for schemes (5) and (6) 
can be determined with the use of the appropriate Tay- 
lor’s formulas in the same way as we did for Poisson’s 
equation in 10.4. As a result we find that the difference 
schemes (5), (7) and (6), (7) approximate problem (1)- 
(3) with an error O (т -- &?), i.e. 


Il Дил -ім IS M (т + А). (10) 


The theory of difference schemes proves the validity 
of thefollowing properties. 

1°. For r< 1/2, the explicit scheme (5), (7) hasaunique 
solution and is stable, and for rœ 1/2 it is unstable. 
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29, Тһе implicit scheme (6), (7) has а unique solution 
and is stable for any r. 
Thus, on the basis of the theorem from 10.4, relation 
(10) and the properties just formulated, we can assert 
.the convergence of the explicit scheme for r< 1/2 and 
the implicit scheme for any k and т with the error 
О (т + A). 
Example. Solve problem (1)-(3) for f = 0, ug = z (1 — z), Po = 
Po = 0, T = 0.1. 
А A In this, caso equation (1) and conditions (2), (3) assume the 
orm 
Ut — uyy = 0 (0<<:<21, 0<156 0.1), 
и (т, 0) = z(1—z) O<z< 1), 
u (0, t) = u (1, 2)—0 (0<:<04). 
We take the explicit schemo (8) аз the scheme for computations. 
We set h = 0.25 and then t< 0.03. Since T = 0. 1, ме take т = 
0.025 for M to be an integer (М == ). We find that r == t/h? = 0.4. 
Тһе computational formula has the form 


oH soa (ut 4o i) RU (01, 2, 3, k =0, 1,2,3), 
op AER) Lum (0-1, 2, 3, bet, 2, 3, 4). 
Thus we get initial conditions v? := 0. 1875, 10 = 0,2500, іл = 


0.1875 and boundary conditions vh = 0 := 0. 
At tbe first step we have 


vi nA (oh 03) EP. 250 == 0.4375, 
vy ==0.4 (07 9). -0.228 — 0,2900. 


Ву virtue of symmetry v) = vl = 0.1375. The calculations at 
the next steps are similar. 
All the calculations are given in Table 10.6. A 


Table 10.6 
N 
k 
0 1 2 3 4 

oft 0 a 0 0 
" 0.1875 | 0.1375 | 0.1075 | 0.0815 | 0.0627 
№ 0.2500 | 0.2000 | 0.4500 | 0.1400 | 0.0884 
vh 0.1875 [40.1375 | 0.1075 |l 0.0815 | 0.0027 


h 0 0 0 - 0 
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10.6. Difference Schemes for Solving the Equation of 
Oscillation of a String 


Let us consider the frst boundary-value problem for 
the equation of the oscillation of a string in a rectangle 
D {б< < 1, 0x; ix T). We have to find a solution 
of the problem 


Lu = uy, —uxx = f O<2<1,0<t< T) (1) 
и (т, 0) = ш (г), ш (х, 0) = ш (г) (б< г<< 1), (2) 
и (0,1) = Po (0), u (1,0 = Yo (0) xt T) (8) 


continuous in D. 

The application of the method of finite differences to 
the solution of problem (1)-(3) differs but slightly from 
its application to the equation of heat conduction*. 
The domain D is covered by a net фуу. The difference is 
in the approximation of the second derivative with re- 
spect to the variable t: 
ий-1 — 21 4- utt! 
т (4) 
The difference approximation of the equation assumes 
the form 


(Ute) = 


-1 алан h L—2vh- pv) 
№ 1 — 29h + Un - 177 208 bP at =- fË. 5 
ee (5) 


The initial conditions arc approximated as follows: 


ГӘ = 


-1 


09 = ug (nh), тты. (ай) (п--0, 1, ..., N). (6) 


The boundary conditions are approximated in Ше same 
way as for the equation of heat conduction: 


và — фо (Ат), v= фо (іт) (k=0, 1, ..., М). (7) 


Five-point scheme (5) of the "cross" type is shown in 
Fig. 10.2. 


1 . . 
* In this section we use designations and concepts accepted 
in 10.4 and 10.5. 
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The quantity v;! is an apparent (dummy) unknown 
which can be found from relation (6) and substituted into 
equation (5). In this case we get a simple explicit scheme 
(y — vh): 

vat tes — op Y (vna d vni) +2 (0 — Y?) n+ fa. 
(8) 

The order of approximation of the difference scheme 
(6)-(8) сап be found in the same way as il was done in 
10.4 for Laplace's equation. Тһе verification shows that 
the error of the approximation scheme (6)-(8) is О (v? + 
h?), and in addition, this scheme is stablo for y? = 
(t/h)?< 1/(1 -+ е), е 2-0. Thus it converges with ап 
error of the order of О (т? 4|- А?) under the indicated con- 
dition. 

Example. Solve problem (1)-(3) for f = 0, u = z(1— z), u, = 
Po = Po = 0, Т = 0.6. 

А Ме set k = 0.25 and then т < 0.25. Since 7 = 0.6, we take 
t= 0.2 fez А. io bo an integer (M = 3). We calculate ү? = 
(т/һ)2 = 0.64. The computational formula has the form 


yi s — 71.0.64 (vB. , J- v8 44) 10.7295 (n—1, 2, 3), 


о. h(h—n) vh—vn! — 2 Р 
0 Рс ор =" (9-0, 1, 2, 3, 4). 
vb — A —0 (k-=0, 1, 2, 3, 4). 

Thus we get initial conditions v}? = 0.188, v9 = 0.250, 00 = 
0.188, v;! = vi, and boundary condiLions vi = vi = 0 (k=0, 
1, 2, 3, 4). 

At the first step we need the value of the apparent quantity v, 
to calculate vt. We find it from the initial condition vj! = vt. Thus 
at the first step we havo 

vl = -- uh 4-0,64(09 00, 1) 470.7299. 
Hence 
v! = 0.32 (v8 -+ v9) 4- 0.3601 = 0.148, 
vi = 0.32 (v9 + v9) 0.3608 = 0.210. 
By virtue of the symmetry of the problem, vj = vi = 0.148. 
At the second step we obtain 
v? = — v9 -- 0.64 (v]- |- v$) 4- 0.7201 = 0.053, 
vi = — vj 4- 0.64 (v] 4- vl) 4- 0.7201 — 0.091, 
By virtue of the symmetry of the problem, vj = v? = 0.053. Ву 


analogy we make calculations at the next steps. 
All the calculations are shown in Tablo 10.7. A 


32* 
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Table 10.7 

h | 0 | 1 | 2 | 3 
E 0 0 0 0 
vt 0.188 0.148 0.053 —.052 
vh 0.250 0.210 0.094 —0.077 
v% 0.188 0.148 0.053 —0.0152 
DA 0 n 0 0 

Exercises 


1. Find ап approximate solution of the Laplace equation 
д?и u 


"um ау" for a square under the indicated boundary 
conditions: 
-(а) (b) 
16.18 38.63 17.98 39.02 
0.00 e e e e 50.00 0,00 e e e e 50.00 


0.0 ОС O e€310 nme С) O e 30.10 
owe O . О e1238 0000 O O e 12.38 
0.00 e e e ө 4.31 0.00 ө e e ө 4.31 
26.15 29.34 29.05 29.03 

2, Find an approximate solution of the Laplace equation 
ооз =0 with а stepsize л == 1/6 for a square under the 
indicated boundary conditions: 

9.81 19.78 29.12 40.16 42.31 


0.00x X х х х x х5). 
00x O О O O O х.б 
0.00x О O O O O x33.11 
0.00x O O O O O 19.14 
0.00x O O Q O O x13.00 
00x O О О O О  x6.98 
0.00 X x x x x x х4.31 


17.28 31.96 40.00 30.50 17.28 
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2 
3. Find an approximate solution of the equation ES a $ 
which satisfies the conditions u (г, 0) = gy (2), и (0, t) = fy (2, 
и (1, t) = f, (t) for the values О< i< 7, taking a step h == 0.1 
with respect to the argument г. Consider two variants of the bound- 


ary conditions: 
(а) go (2) 5 = (1.122 -H 1.1) sin лг, у (1) =f, (0-0, T= 
0.02, r = 
fy (0 = 2,3, у, (t) = 3.4051, 


b) Zo БР = - (1. 1 -- 2.3) ест, 
44, r= 


Answers to Exercises 


Chapter 1 
1. (a) 2.7546, 2.755, 2.75, 2.8, 3, (b) 3.1416, 3.142, 3.14, 3.1, 3, 
(c) 0.5645, 0.565, 0.56, 0.6, 4, (d) 4.194, 4.19, 4.2, 4, (с) 0. 6065, 
0.007, 0.61, 0.6, 1. 2. (a) 1. 14, А, =0. 0026, &, = 0. 23% , (b) 0. 0102, 
A, == 0.00005, ё, = 0.5%, (c) 0 0.124, A, = * 9. 0005, 5, — 0. 41%; 
@) 922, A, — 0.45, 6, = 0.049%, (e) 0.00246, A, = 0.000002, 
a = 0.082%. 3. KA 0.018, (b) 0. 099, (c) 0.047, (d) 2.0, (c) 0.00035. 
4. (9. (b) 4, (с) 3 2, e) 3. 5. (а) The second, 9 the second, (c) the 
t 


04 

(e 
rst, (d) the second, (e) the second. 6. a= 47.5. 7. 46.39. 8. 3.29. 
A, = 0. = 0.007596, (b) A, == 0.0005, 5, = 0.003%. 
10. (a) y — 0.085, == 0.0012, 6, = 1.4%, (b) y >: 1.20, Ay = 
.056, by = 47%, ^b y = 0.0552, A, = 0.00043, 8, = 0.77%, 
(d) у = 2.747, Ay = 0.0090, 6, = 0.33. 11. “ays 0.494, (b) s = 
.687. 


Chapter 2 


15-5 
| |. Ы Е 1 
29-17 
8-5 54 -72 —72 78 
2. of —30 —100 ив]. (b) | 36 54-6 | 


= 


6 2 
1. (a) | 996 
891 


118 —82 28 66 240 88 
ОЕ} 
3| _ 5 _ | (08 1|, (о) 409. 
2 4 6 12 15 
8- 
4. (a) =» ‚ (b)] 2 |. 5. (а) 22, (b) —26, (с) 4279.1. 
—18 2 


—4 а — - 

—12 —4 8 im ! 4 24 

6. (a) Ағ1»| —9 —1 6], (b) Ade’ 10 —1 7 —36 
| 72451 jB|-14 —13 7 12] 

mn 0 0 -96 48 
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24 0 00 
1 0 1200 
-J 
б) 4*——-| 4 0960): 
—28 —5 28 
24 57 15 3 012 3 2 
_|—4 166 11 22402-14 2-3 
.АВ-| i6377 14| 07748 3.2.4 оф 
10 53 13 29 —2—3 2 1 
6 —40 8 
1 |42 59-4 
-1— = = 
(0) 4^—49| 42. 49 —43 | % (94-717; 
—6 —5 9 1 
4.0 о о 123 —2 
2-5 0 о [[0o185—U5| a rara 
8--4 — 18/5 0 001 -2 | а 
2-7 36/518 || 000 1 
41-245 2p ! 0 0 n 
0 485—ə 25-45 0 о |. 
0 04 2| 748 4/18 —5a80 |= 
o oo 411-248 —348 2/48 4/18 
12 3 2 30 оо 
1 2-1 2-3 | .5 278 0 0 
18| 3-2-4 2[|04-85:—|34.. 470 1% 
—2—3 2 1 4 8/3 —9/7 18 


0 0 0 1 

1 2/3 —4/7 8 из 0 0 n 

o1 47-1 || —; зло o 

00 1 —13 -5 —8 7 0 

oo о 101 —4/3 —5/8 9/48 1/18 

4 M 7$ ^ і 8 12-1 
—| ~ ={|0 — 

18 | -42 149 —13 p 1% @) Х 5 ! 2 

—8 —59 1 


1—23 2/3 0 
0 1 -а4/ —6/7 -1— B-1— pn-1— 
f о 4 ag | AUS B= Rit 


0-1 2 
(b) x-fi: 0 4l 11. (а) r—2, (b) r—2. 12. It is linearly 
з 1 2 
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dependent, (b)it islinearly independent. 13.. Тһе basis is com- 
posed, say, of the vectors x,, Xa, X4; X3 =X; — х). 14. y= (5/4, 1/4; 
). 


Chapter 3 


(а) ж = — (11/7)z,, z, = — (1/7)z, (b 2) = (Зх, — 
1321/5, т, = (19z, — 20z,)/17. 2. Тһе general solution is z, — 
(t3—92,4—2)/41, т,--(--5та + 1, + 10)/11; the particular solu- 
tion is z, — —1, z4— 1, z49— 0, z,—1, (b) the general solution is 
тз = 22z, — 332, — 11, z, = — 16z, + 24r, + 8, the particular 
solution is z, — 1, z, — 0, zy = 11, т, = —8. 'з. (а) 2; = 0, 
Z, = —1, z54—2, (b r= 2, y = —2, z — 1. 4. (а) г = 1, 
т -1, z4— 1, 1,---1, oa t= 2, nc 

+ = 3. 5. (8) z, — 1.120, z, — —0.3 4, z, = — 0.00 8, (b) z = 
0:008; у = — 0.231, 2 = 0.042. 6. (a) d = 88, (b) d = 2141.97. 
10/3 —7/6 1/2 —1/6 
— 5/3 5/6 --1/2 --7/6 


-1 — 
7.(094^—| 4. a a al 

4 —Am 14/2 4/2 

149 —0.34 —0.82 —0,12 

—047 457 41.23 0.70 

-1— 

(b) 47— —4.75 044 0.30 0.87 

—0.12 — 2.92 —109 0. п. 
8. (a) z = —0.72, = 1.88, ғ = (bz — 
1.22, — 067, z= 0.35. 10. G TEES ШУ А 1.9, 
|4 |; = 2:55 (b |14 | 145, 114 l; = 1.0 07, WA [fa = 1.20. 
11. (a) т, = 1,2, = — 1, z, = 2,2, = 0, тү = 1/2, z, = 3/2, 
n.o , z, = — 2, 12. (а) z = — 2, z= 2, Тұ = —3, 


т, = 3, (b) т. = 1, т, = 1, т) == —1. 


Chapter 4 


1. The remainder із г = P, (3) = 430, tho quotient is РА == 
z^ + 623 + 1612 + 48: + 143. 2. Yes, it is. 3. (a) 0.423,(b) 0.940, 
(c) 1. 386, (d) 1.221, (с) 0.809, (f) 0. 309. 4. (a) 3.464, (b) 7.483, 
(c) 6.4 


Chapter 5 


(a) — 1.325, (b) 1.180, (c) — 1.876, 0.578. (d) 0.781, 2.404, 
(e) 50 0. 399, 6.352, (f) 0.310, 4.0. 2. (a) 1. 213, (b) 0.706, (с) 0.844, 
(d) —0.438, 0.438, (e) 0.0, 0.787, (f) 1.897. 3. (a) —4.071, 

0.993, by" —0.695, —3.067, 3.757, (с) —3.523, —1.567, 1 086, 
(d) 0.398, 4.862, (e) 0.0, 2.753, (f) 0.739. 4. (a) 0.760, (b) — 2.258, 
(c) —0.465, (4) —0.567, —0.335, 0.0, (е) 3.473, (Р) 1.422. 
5. (a) —04532, 0.653, 2.879, (b) —0.475, 1.395, (с) —1.582, 
0.402, 1.378, (4) —1.453, 1.164. 6. (a) 0.187, (b) 0.755, (c) 0.739, 
(d) 0.807, (e) 0.672. 
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Chapter 6 
1. (а) А3 — 2А2 — 66,.--1, (b) 44—433—64 —44, (е) 414—448 4- 


13 4 
1604—16. 2. (а) Ay=:7, z,—c [i] м--2, x,-c[ м ; 


—2 1 
(b) à= —2, nza | ыы 3. (a) АЗ-РА2 3А — 7, 
0 1 


(b) 41-8134-63- 6A — 54, (c) A1--A3—62?--18A. 4. (a) М- 
7494-1542 — 23 — 34, (b) 14 АЗ- РТА2 — 20% — 54. 6. D(A) = 


1 
А —3A3-L-3A—1, А = А, = А1, х0) = д) = x) = | | it 


-4 
Е 
r= |0 |. 7. М 4.46, 41.59. 


ü 


Chapter 7 
1. 20.819, 2. 24.680. 3. 2, (х) = — (1/15)? — (3/20)22 + 
(241/60)z — 39. 4. (т) — 0.0735z? — 0.4530z -H 0.7474, A= 
0.23 х 10 i. ;. 3.37215. 8. 4.379. 9. 1.43612. 10. 0.75487. 


13. (a) 0.6115 + 0.00013, (b) 0.9409 -- 0.0007, (c) 0.9456 -- 
0.002, (4) 0.8007 + 0.0009, (с) 0.3156 + 0.00012, (1) 2.4505 + 
0.0018. 14. Q, (г) = 2 — 0.7 cos 2z — 0.3 sin 2z - - 0.3 cos 4z -r 
b, sin 4z. 15. 0, (z) = —1 + (7/3) cos 2nz — (2/ V3) sin 2nz — 
соз Amr. 


Chapter 8 


1. 15.160, 2. 1.429. 3. 2.28. 4. 2.002. 5. 0.107250. 6. 0.67363. 
7.0.6931472. 8. 0.007. 9. 0.0087. 10. (a) 0.239, (b) 0.223, (c) 1.000, 
(D 0.8349, (e) 1.4627, (f) 1.5625, (g) 1.333, (h) 0.460, (i) 1.748. 

a) 0.754 + 0. 002 (for hy = 3°), (b) —0.471 + 0.002 (for 

- 7), (c) 2.421 + 0.007 (for л, = 1°), (d) 0.953 + 0.002 
(for ha == 6°), (е) 0.892 £ 0.0015 (for һу = 3°), (с) 1.438 2: 0.003 
(for à, = 3°). 


Chapter 9 


. (a) уз -l- 82? -]- (56/3)z? + 1824 4- 8:5 + (4/3) z®, (b) 1 73 -= 
-- z A- £? — (1/3) 23 4- (1/24) т. 2. у(х) = 1 + 2r — 0.71 — 
б. 256723 4- 0.05124 + 0.0014725 — 0.00101z9. 3. y = «3/3 +|- 
z'/63 -+ . 4. (а) y = — 41.14, y, = —1. 18, Yq == —1.238, 
уа = —1.2718, yg = —1.2790, (b) y, = 0, yy = 0,01, 
0.0278, y, = 0.0524, y, == 0. 08192, ув = 0.115536, y, == “лов, 
уз == 0.191943, n = 0.233554, Yio = 0.276844. 5. yy == 1, 
1. 1836, у, 7 453420, у, = 14880, у, = 1.6152, у, = 1.1362. 
6. ^71. 1.1867, H 1,3484, ya = 1.4938, y, = 1.0272, 
уу = 1.7542. 7. (а) уу: 0, gp = 0.10536, y, == 0.223130, уу = 
0.356601, y, — O. 510424, ys = 0.691497, ya = 0.910454, y; = 
1. 184648, y Yq = 1.544491, y, — 2.048721, yyy = 2.827617, (b) уу = 
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2.00, y, — 1.81, nts уз = 1.49, y, = 1.36, ge = 1.25, 
ya = 1.16, y; = 1.09, ув = 1.04, y, = 1.01, B. y, = 0.8110, y 
0.8196, ya = 0.8464, уу = 0.8808, у, = 0.9460, y, = 1.0197, 
Jio = 1.1037. 


Chapter 10 
0.0046.18|38.63|59.00 0.00)17.88138.9250.00 
0.00 t4. 12/26 .09/30 .10 0.0)5.18|36.39/30.10 
1. (а) (b) 


0.00[45.20)20 sa]t2.38 0.00)16.37|24 .26]12.38 


0.00[26.45]29.34] 4.31 0.00]29.05|29.63| 4.34 





























| 9-81 | 19.78 | 2942 | 4046 | 42.31 | 
0.00 | 8.97 | 17.58 | 25.36 | 32.48 | з 6.11 | 40.16 
0.00 | 8.68 | 16.00 | 22.29 | 26.86 | 29.69 | 33.11 
2, 0.00 | 8.36 | 15.59 | 20.4 | 23.05 | 22.62 | 19-14 
0.00 | | 17.22 | 24.74 | 21.85 | 18.55 | 13.00 
0.00 | 42.20 | 22.09 | 26.96 | 24.01 | 16.70 | 6.98 
| 17.28 | 31.96 | 40.00 | 30.50 | 17.28 | 
i | 1 |.2 3 4 5 6 1 8 9 
(а) 0.000 0.343 0.672 0.970 1.213 1.375 |1.423 4.327 | 1.062 0.618 
0.005 (0.336 (0.656 [0.943 4.172 1.318 4.351 14.243 0.973 0.531 
0.040 [0.328 |0 .639 (0.944 11.131 1.262 |1.281 (1.162 | 0.887 | 0.486 
0.015 |0.320 10.624 |n.885 1.088 1.206 4.212 4.084 | 0.824 | 0.443 
0.020 10.314 10.602 [0.855 1.045 4.150 1.145 1.018 |0.764|0.412 
3. 
0.000 [2.091 4.919 4.777 4.660 4.562 1.480 |1.410 | 1.350 | 1.297 
0.047 2.097 |1:924 [1.781 |1.663 (1.564 8.482 1.411 | 1.351 | 1.298 
(b) 0,033 |2.102 4 .929 [1.785 4.666 1.567 1.484 1.413 | 1.352 | 1.299 
0.050 [2-406 1-994 1-789 1.670 4.570 4.486 |1.415 | 1.354 | 1.300 
0.067 [2.110 4 .939 |1.794 1.673 |1.572 [4.488 |17416 | 1.355 | 4.804 





Index 


Absolute, error 17 
value of a matrix 89 
of a vector 90 
Adams' extrapolation method 
452, 454, 457 
Adjoined matrix 58 
Aitken's iterated interpolation 
339 
Algebraic, adjunct 50 
equation 184 
function 180 
polynomial 165 
Analytic method of representing 
a function 283 
Approximate, number 14 
valuo of a number 17 
Arithmetic progression 347 
Auginented matrix of a syslem 
of equations 110 


Back substitution 127, 130 
Base, equation 115 
minor 99 
unknown 115 
Basic climination procedure {21 
Bezout’s theorem 168 
Bisection method 194 
Bordered matrix 79 
Bordering 79 
Boundary conditions 475 
Boundary-value problem 465 
classical solution of 476 
homogeneous 467 
linear 467 


Cauchy’s problem 425, 474 
for hyperbolic cquations 477 


for parabolic equations 478 
for an unbounded domain 476 
Central difference 309, 311 
Characteristic, determinant 239 
equation 239 
polynomial 239 
value 237 
Chebyshev э method “of filting” 
29 


polynomial 341, 342 
Cholesky’s method 144 
Classical solution of a bounda- 

ry-value problem 476 
Coefficient, of Cotes, 400 

of an equation 181 

of Fourier 351 

of a system of equations 108 
Cofactor 50 
Columns, matrix 40 

vector 40 
Conjugate matrix 58 
Consistent system of cquations 

1 
Constant, term 108, 16^ 

unknown 115 
Control sum 130 
Convergent, method 415 

sequence 348 

series 349 
Coordinates of a vector 41, 99 
Cramer’s rule 112 


Deficiency of a matrix 91 
Determinant 48 
principal diagonal of 48 
propertics of 52-55 
of the second order 48 
secondary diagonal of 48 
of the third order 49 


508 


Determinate system of equa- 
tions 109 
Diagonal, matrix 41 
minor 67 
Difference of matriccs 43 
Difference, method 483 
problem 489 
Differential equation 423 
degree of 434 
elliptic 472 
hyperbolic 472 
integral of 424 
general 424 
ordinary 423 
of order n 424 
parabolic 472 
partial 423 
solution of 424 
Dimensions, of a matrix 40 
of space 98 
Dirichlet’s problem 479 
Discriminant 472 
Divergent, sequence 348 
series 349 
Divided difference 329 
of order zero “329 
Domain, of convergenco of a 
functional scrics 350 
of definition of a function 
190 
of existence of a function 
190 
of permissible values of an 
equation 179 
Doubtful digit 21 


Eigenvalue 237 
Eigenvector 237 
Elementary transformation, of 
a determinant 55 
of a matrix 93 
of a system of equations 
109 
Elements of a vector 41 
Equal matrices 42 
Equation, gi heat conduction 
47 


of Laplace 478 
of oscillation of a string 474 
of Poisson &474 
Equispaced interpolation nodal 
points 307 


Index 


Equivalent, matrices 93 
systems of equations 109 
Error 17 
of approximation 15 
of a boundary condition 
488 


of an equation 487 
of interpolation 295, 297 
of a method 15 
of rounding 15 
Euler’s, broken line 436 
method 434 
Exact method of solving a pro- 


blem 240 
Expansion, of a determinant 
according to tho ele- 
ments of a row (co- 
lumn) 51 
of a function in a Fourier 
series 351 


Extrapolation 293 


Finite difference 289, 309 
backward 309, 311 
central 309, 311 
forward 309, 311 

Finite-dimensional space 98 

Formula, of Adams 454 

of Gauss 410 
rectangular 382, 384 
of Simpson 402 
compounded 418 
Forward substitution 127, 130 
Fourier, analysis 357 
coefficient 351 
series 351 
Free term of a system of equa- 
tions 108 

Frobenius matrix 201 

Function 283 

Functional dependenco 283 

sequence 348 
series 349 
trigonometric 351 
Fundamental, system of equa- 
tions 118 
theorem of algebra 224 


Gauss' scheme 127 
Gaussian, elimination 124 
quadrature formula 410 


Index 500 


General, integral of a differen- 
tial equation 424 
solution of a differential equa- 
tion 424 
Goneralized Horner’s scheme 
170 
Geometric progression 347 
Graph of a function 284 
Graphical method, of represent- 
ing a function 284 
of separating roots 184 


Harmonic, analysis 347 
function 480 

Hermite polynomial 345 

Homogeneous, boundary-valuc 

problem 467 

system of equations 109 
Horner's, method 231 
scheme 157 

Tlypermatrix 78 


Identity matrix 41 
Implicit scheme 496 
Incompatible system of equa- 
tions 109 
Inconsistent system of equa- 
tions 109 
Indeterminate system of equa- 
tions 109 
Infinite-dimensional space 98 
Initial, conditions 425, 474 
data 425 
interval 454 
value 425 
Initial-value problem 425 
Input data 481, 482, 489 
Integral, curve 424 
rational function 180 
Interpolation 293 
backward 366 
error of 295 
formula 398 
linear 297 
in narrow sense 293 
hy polynomials 294 
quadratic 297 
in the sense of Hermite 345 
in the sense of Lagrange 345 
in tables 336 


Interpolation polynomial 295 
Bessel’s 322, 323 
Lagrange’s 304, 306 
Newton's 325, 326 
Stirling’s 320, 322 

Inverse matrix 57 

Inversion of a matrix 57 

by expanding it in a product 
of two triangular mat- 
rices 72 

hy partitioning it into blocks 
82 


by successive bordering 85 
Invertible matrix 57 
Irrational function 181 
Iterative, method of solving 

a problem 241 

process 148 


Kronecker-Capelli theorem 110 
Kronecker delta 139 


Lagrange's multiplier 304 
4-differenco 279 
Limit of a sequence 348 
Linear, boundary-value 
problem 467 
combination of vectors 90 
dependence of vectors 90 
independence of vectors 96 
interpolation 297 
space 95 
Linearly independent equations 
115 
Lipschitz condition 425 
Loss of accuracy 26 
Lower triangular matrix 06 


Mantissa of a number 20 
Matrix 40 
equation 63-66 
of Frobenius 261 
square 41 
of a system of equations 109 
of transformation of an old 
basis into a new one 


104 
Method, of Adams 452, 454, 457 
of Aitken 339 
of bisection 194 
of bordering 92 
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оғ сһогбз 197 
of Danilevsky 260, 263, 270- 
274 
of direct expansion 241 
of Euler 434 
modifications of 439 
of Euler-Cauchy 441 
of finite differences 483 
of Horner 231 
of iterations 148-150, 
214, 277 
of separating roots 18% 
analytical 189 
graphical 184 
of Krylov 245, 253 
of Lagrange, of finding the 
upper bound of posi- 
tive roots of an equa- 
tion 229 
of least squares 294 
of Leverrier-Faddeev 254, 258 
of Milno 459 
of Newton, of finding the 
upper. bound of posi- 
tive roots of an equa- 
tion 230 
of partitioning into blocks 82 
of Pickard 426 
of representing a funclion 284 
analytical 282 
graphical 284 
labular 284 
of Seidel 156-159 
of successive, differentiation 
430 
approximation 148-150, 176 
214 


176, 


bordering 85 
elimination of unknowns 
124 
of tangents 203 
of undetermined coefficients 432 
Methods of representing a func- 
tional relation 283 
analytical 283 
graphical 284 
tabular 284 
Minor, of an element of a deter- 
mibent 50 
of order k of a matrix 91 
Mixed boundery-value problem 
7 


Index 


Monotonic function 190 
n-dimensional linear space 98 
Natural scale 347 
Net 484 

domain 484 

function 485 
Neumann's problem 479 
Newton's, interpolation formu- 

la 327 

method of approximation 203 

Newton-Cotes quadrature for- 


mulas 400 
Nodal point 293, 484 
Node 485 


Noninvertible matrix 57 
Nonremovable error 15 
Nonsingular matrix 57 
Norm, of a matrix 9) 
on the set of net functions 
487 
of a vector 90 
Normal form of a system of li- 
near equations 149 
Normalized form of notation of 
à number 20 
Null matrix 42 
Numerical, diíferentiation 374- 


integration 379-382 


Order, of approximation of a 

boundary-valuo pro- 
blem 488 

of convergence of a difference 
scheme 490 

of correctness of a table of 

finite differences 315 

of a differential equation 421 

of a number 20 

of a square matrix 41 


Partial sum of a series 349 
Particular solution of a differ- 
ential equation 424 
Periodic function 354 
Piecewise-continuous function 


Piccewise-monotonic function 


Pivot, coefffcient 124 
element 124 


Índex 544 


row 121 
unknown 124 
Power series 349 
Principal diagonal 41 
Principle, of the maximum 480 
of Runge 455 
Problem, Cauchy's 425, 474 
for hyperbolic equations 477 
for parabolic equations 478 
for an unbouded domain 476 
Dirichlet’s 479 
with initial conditions 425 
without initial conditions 475 
Neumann's 479 
Product, of a matrix by a num- 
ber 43 
of two matrices 44 
of a vector by a scalar 46 


Quadratic interpolation 297 
Quadrature 379 
formula 572 
for interpolation 398 
of Newton-Cotes 396 


Rank of a matrix 91 
Rational function 180 
entire 180 
integral 180 
Rational fractional function 184 
Rectangular matrix 40 
Relative error 18 
Hoot, of an equation 179 
of multiplicity s 166 
of a polynomial 166 
Rounding error 45 
Rounding off 16 
Row, matrix 40 
vector 40 
Rule, of annulus 228 
of calculating digils 36-37 
of Descartes 225 
of rounding off 16 
of triangles 49 
Runge's principle 455 


Scheme of unique division 127 
Seidel's method 156 


Separated root of an equation 
184 


Sequence 347 
constant 347 
convergent 348 
divergent 348 
general term of 347 
Series 349 
convergent 349 
divergent 349 
of Fourier 351 
sum of 349 
Significant digit 17 
valid 20 
Simple root 166 
Singular matrix 57 
Solution, of a differential equa- 
tion 424 
of an equation 179 
of a system of equations 108, 
80 


Square matrix 41 

Space basis 98 

Stability |: a difference problem 
89 


Step of iteration 434 
Step matrix 78 
Subdiagonal matrix 66 
Sum, of matrices 42 
of series 349 
of vectors 46 
Superdiagonal matrix 66 
Symmetric matrix 42 
System of equations 108, 144, 
118, 124, 179 


Tabular method of representing 
a function 284 
Theorem, of Bezout 168 
on a base minor 100 
on convergence of а differ- 
ence scheme 490 ` 
of Dirichlet 352 
fundamental, of algehra 224 
of Hamilton-Cayley 245 
of Kronecker-Capelli 110 
onlinear dependence of vec- 
tors 96 
of Sturm 228 
Theorems, on continuous 
functions 189 


512 Index 


on convergence of interpola- 
tion process 215 

on determinants 50-52 

on quadraturo formulas 408- 
09 


Trace of a matrix 242 
Transcendental function 181 
Transpose of matrix 46 
Trial and error method 192 
Triangular matrix 66 

lower 66 

upper 66 


Unit, matrix 41 
vector 98 


Unknowns 108 
Unremovable error 15 
Upper triangular matrix 66 


Valid digit, in a product 30 
in a quotient 34 
significant digit 20 
Value of a decimal position 16 
Vector 41 
Vector space 95 


Zero of a polynomial 166 
Zero matrix 42 


